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Preface 


Our goal in this set of lecture notes is to provide students with a strong foundation in mathematical 
analysis. Such a foundation is crucial for future study of deeper topics of analysis. Students should be 
familiar with most of the concepts presented here after completing the calculus sequence. However, 
these concepts will be reinforced through rigorous proofs. 

The lecture notes contain topics of real analysis usually covered in a 10-week course: the 
completeness axiom, sequences and convergence, continuity, and differentiation. The lecture notes 
also contain many well-selected exercises of various levels. Although these topics are written in a 
more abstract way compared with those available in some textbooks, teachers can choose to simplify 
them depending on the background of the students. For instance, rather than introducing the topology 
of the real line to students, related topological concepts can be replaced by more familiar concepts 
such as open and closed intervals. Some other topics such as lower and upper semicontinuity, 
differentiation of convex functions, and generalized differentiation of non-differentiable convex 
functions can be used as optional mathematical projects. In this way, the lecture notes are suitable 
for teaching students of different backgrounds. 

Hints and solutions to selected exercises are collected in Chapter 5. For each section, there is at 
least one exercise fully solved. For those exercises, in addition to the solutions, there are explanations 
about the process itself and examples of more general problems where the same technique may be 
used. Exercises with solutions are indicated by a > and those with hints are indicated by a >. 

Finally, to make it easier for students to navigate the text, the electronic version of these notes 
contains many hyperlinks that students can click on to go to a definition, theorem, example, or 
exercise at a different place in the notes. These hyperlinks can be easily recognized because the text 
or number is on a different color and the mouse pointer changes shape when going over them. 


Changes in the Second Edition 


The second edition includes a number of improvements based on recommendations from students 
and colleagues and on our own experience teaching the course over the last several years. 
In this edition we streamlined the narrative in several sections, added more proofs, many examples 
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worked out in detail, and numerous new exercises. In all we added over 50 examples in the main text 
and 100 exercises (counting parts). 

We included more prominently the notion of compact set. We defined compactness as what is 
more commonly termed sequential compactness. Students find this definition easier to absorb than 
the general one in terms of open covers. Moreover, as the emphasis of the whole text is on sequences, 
this definition is easier to apply and reinforce. 

The following are the more significant changes. 


Chapter 1 Added the proofs of several properties of the real numbers as an ordered field. 


Chapter 2 We added the proof that compactness is equivalent to closed and bounded in the main 
text. 


Chapter 3 We added the theorem on extension of uniformly continuous functions and moved the 
discussion of Lipschiptz and Hélder continuous functions to the section on uniform continuity. 
We created a separate section for limit superior/inferior of functions. 


Chapter 4 We clarified the statement and the proof of the second version of L’ Hospital’s rule. 


We have used these notes several times to teach the one-quarter course Introduction to Mathe- 
matical Analysis I at Portland State University. As we are now preparing a companion text for the 
second term (Introduction to Mathematical Analysis II) we now added the roman numeral I to the 
title. 


1.1 


BASIC CONCEPTS OF SET THEORY 

FUNCTIONS 

THE NATURAL NUMBERS AND MATHEMATICAL INDUC- 
TION 

ORDERED FIELD AXIOMS 

THE COMPLETENESS AXIOM FOR THE REAL NUMBERS 
APPLICATIONS OF THE COMPLETENESS AXIOM 


1. TOOLS FOR ANALYSIS 


This chapter discusses various mathematical concepts and constructions which are central to the 
study of the many fundamental results in analysis. Generalities are kept to a minimum in order to 
move quickly to the heart of analysis: the structure of the real number system and the notion of limit. 
The reader should consult the bibliographical references for more details. 


BASIC CONCEPTS OF SET THEORY 


Intuitively, a set is a collection of objects with certain properties. The objects in a set are called 
the elements or members of the set. We usually use uppercase letters to denote sets and lowercase 
letters to denote elements of sets. If a is an element of a set A, we write a € A. If a is not an element 
of a set A, we write a ¢ A. To specify a set, we can list all of its elements, if possible, or we can use 
a defining rule. For instance, to specify the fact that a set A contains four elements a,b,c,d, we write 


A=16,b;6d}-. 
To describe the set E containing all even integers, we write 
E = {x: x= 2k for some integer k}. 
We say that a set A is a subset of a set B if every element of A is also an element of B, and write 
ACBorBDA. 


Two sets are equal if they contain the same elements. If A and B are equal, we write A = B. The 
following result is straightforward and very convenient for proving equality between sets. 


Theorem 1.1.1 Two sets A and B are equal if and only ifA C Band BCA. 
If A C Band A does not equal B, we say that A is a proper subset of B, and write 


AGB. 
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The set 0 = {x: x # x} is called the empty set. This set clearly has no elements. Using 
Theorem |.1.1, it is easy to show that all sets with no elements are equal. Thus, we refer to the empty 
set. 


Throughout this book, we will discuss several sets of numbers which should be familiar to the 
reader: 


e N= {1,2,3,...}, the set of natural numbers or positive integers. 


e Z={0,1,—1,2,—2,...}, the set of integers (that is, the natural numbers together with zero 
and the negative of each natural number). 


e Q={m/n:m,n€ Z,n FO}, the set of rational numbers. 
e R, the set of real numbers. 
e Intervals. For a,b € R, we have 


[a,b] ={xER:a<x<b}, 
(a,b] = {xER:a<x<b}, 
[a,oo) = {x ER: a<x}, 
(a,o) = {x €R:a<x}, 


and similar definitions for (a,b), |a,b), (—°°,b], and (—2,b). We will say more about the 
symbols c¢ and —c9 in Section 1.5. 


Since the real numbers are central to the study of analysis, we will discuss them in great detail in 
Sections 1.4, 1.5, and 1.6. 


For two sets A and B, the union, intersection, difference, and symmetric difference of A and B are 
given respectively by 


AUB={x:xE€Aorxe€ B}, 
ANB={x:x eA and xc B}, 
A\B={x:x€Aandx ¢ B},and 
AAB=(A\B)U(B\A). 
If AN B = 9, we say that A and B are disjoint. 
The difference of A and B is also called the complement of B in A. If X is a universal set, that is, 


a set containing all the objects under consideration, then the complement of A in X is denoted simply 
by AS. 


Theorem 1.1.2 Let A,B, and C be subsets of a universal set X. Then the following hold: 


(a) AUAS =X; 
(b) ANAS =O; 
(c) (A°)° =A; 


(d) (Distributive law) AN (BUC) = (ANB)U(ANC); 


(e) (Distributive law) AU(BNC) = (AUB)N (AUC); 
(f) (DeMorgan’s law) A\ (BUC) = (A\ B)N(A\C); 
(g) (DeMorgan’s law) A\ (BNC) = (A\ B)U(A\C); 
(h) A\B=ANB.. 


Proof: We prove some of the results and leave the rest for the exercises. 

(a) Clearly, AUA‘ C X since both A and A® are subsets of X. Now let x € X. Then either x is an 
element of A or it is not an element of A. In the first case, x € A and, so, x € AUA*. In the second 
case, x € A and, so, x © AUAS. Thus, X C AUAS. 

(b) No element of x can be simultaneously in A and not in A. Thus, ANAS = 0. 

(d) Letx € AN (BUC). Then x € A and x € BUC. Therefore, x € B or x € C. In the first 
case, since x is also in A we get x € ANB and, hence, x € (AN B)U(ANC). In the second case, 
x € ANC and, hence, x € (AN B)U(ANC). Thus, in all cases, x € (AN B)U(ANC). This shows 
AN(BUC) C (ANB)U(ANC). 

Now we prove the other inclusion. Let x € (ANB)U(ANC). Thenx €ANBorxE€ ANC. 
In either case, x € A. In the first case, x € B and, hence, x € BUC. It follows in this case that 
x €AM(BUC). In the second case, x € C and, hence, x € BUC. Again, we conclude x € AN (BUC). 
Therefore, (AN B)U(ANC) CAN (BUC) as desired. 


A set whose elements are sets is often called a collection/family of sets and is often denoted by 
script letters such as / or &. 

Let J be a nonempty set such that to each i € J corresponds a set A;. Then the family of all sets 
Aj as i ranges over I is denoted by 


{Aj :i€ T}. 


Such a family of sets is called an indexed family and the set I is called the index set. Consider the 
indexed family of sets {A; : i € J}. The union and intersection of this family as i ranges over J is 
defined respectively by 


| JA; = {x : x € A; for some i € I} 
iel 


and 


( Ai = {x : x € A; for every i € J}. 


ie] 


a Example 1.1.1 The following examples illustrate the notation. 


(a) Let the index set be J = N and for each n € N we have A, = [—n,n|. Then 
LUJAn=R = () An=[-1, 1]. 
neN neN 


(b) Here we let the index set be J = (0, 1] and for each a € J we have Ag, = (—@, @). Then 


J Aa = (-1,1) () Aa = {0}. 


acl acy 
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The proofs of the following properties are similar to those in Theorem |.1.2. We include the 
proof of part (a) and leave the rest as an exercise. 


Theorem 1.1.3 Let {A; : i € 7} be an indexed family of subsets of a universal set X and let B be a 
subset of X. Then the following hold: 


(a) BU (NicrAi) = Mier BUA 

(b) BN (UierAi) = Vier BN As 

(c) B\ (MierAi) = Vier B\ Ais 

(d) B\ (UierAi) = Mier B\ Ais 

(e) (Mier Ai)” = Ujer AS; 

(f) (UierAi)® = Mier AS. 
Proof of (a): Let x € BU (Mier Ai)- Then x € Borx € ()j<-,Ai. If x € B, then x € BUA; for alli cI 
and, thus, x € ();-, BUAj. If x € ();<,Ai, then x € A; for all i ¢ J. Therefore, x € BUA; for all i € J 
and, hence, x € (),;-; BUA;. We have thus showed BU (Nic Ai) Cp UA 

Now let x € (cy BUAj. Then x € BUA; for all i € J. If x € B, then x € BU (()je,Ai). If x ¢ B, 


then we must have that x € A; for all i € J. Therefore, x € ()\;<; Ai and, hence, x € BU (Mier Ai)- This 
proves the other inclusion and, so, the equality. 


We want to consider pairs of objects in which the order matters. Given objects a and b, we will 
denote by (a,b) the ordered pair where a is the first element and b is the second element. The main 
characteristic of ordered pairs is that (a,b) = (c,d) if and only if a= c and b = d. Thus, the ordered 
pair (0,1) represents a different object than the pair (1,0) (while the set {0, 1} is the same as the set 
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ae two sets A and B, the Cartesian product of A and B is the set defined by 
Ax B:={(a,b):a€Aand be B}. 

« Example 1.1.2 If A = {1,2} and B = {—2,0, 1}, then 
Ax B= {(1,—2), (1,0), (1,1), (2, —2), (2,0), (2,1)}. 


« Example 1.1.3 If A and B are the intervals [—1,2] and [0,7] respectively, then A x B is the 
rectangle 


[—1,2] « [0,7] ={(,9): —1<x<2, 0O<y< 7}. 


We will make use of cartesian products in the next section when we discuss functions. 


Exercises 


1.1.1 Prove the remaining items in Theorem 1.1.2. 
1.1.2 p> Let Y and Z be subsets of X. Prove that 


(X\Y)NZ=Z\ (YNZ). 


‘For a precise definition of ordered pair in terms of sets see [Lay 13] 


1.1.3 Prove the remaining items in Theorem 1.1.3. 


1.1.4 Let A, B, C, and D be sets. Prove the following. 
(a) (ANB) xC=(AxC)N(BxC). 
(b) (AUB) xC=(AxC)U(BxC). 
(c) (Ax B)N(C x D) = (ANC) x (BND). 


1.1.5 Let A c X and B CY. Determine if the following equalities are true and justify your answer: 
(a) (X x ¥)\ (AB) = (X\A) x (Y\B). 
(b) (X x Y)\ (Ax B) =[(X\A) x YJUIX x (V\B)]. 


1.2 FUNCTIONS 


Definition 1.2.1 Let X and Y be sets. A function from X into Y is a subset f C X x Y with the 
following properties 


(a) For all x € X there is y € Y such that (x,y) € f. 
(b) If (x,y) € f and (x,z) € f, then y = z. 


The set X is called the domain of f, the set Y is called the codomain of f, and we write f: X > Y. 
The range of f is the subset of Y defined by {y € Y : there is x € X such that (x,y) € f}. 


It follows from the definition that, for each x € X, there is exactly one element y € Y such that 
(x,y) € f. We will write y = f(x). If x € X, the element f(x) is called the value of f at x or the 
image of x under f. 

Note that, in this definition, a function is a collection of ordered pairs and, thus, corresponds 
to the geometric interpretation of the graph of a function given in calculus. In fact, we will refer 
indistinctly to the function f or to the graph of f. Both refer to the set {(x, f(x)): x € X}. 


Let f: X — Y and g: X — Y be two functions. Then the two functions are equal if they are 
equal as subsets of X x Y. It is easy to see that f equals g if and only if 


f(x) = g(x) for allx € X. 


It follows from the definition that two equal functions must have the same domain. 
Let f: X + Y bea function and let A be a subset of X. The restriction of f on A, denoted by fia, 
is a new function from A into Y given by 


fia(a) = f(a) for alla € A. 


Definition 1.2.2 A function f: X — Y is called surjective (or is said to map X onto Y) if for every 
element y € Y, there exists an element x € X such that f(x) = y. 

The function f is called injective (or one-to-one) if for each pair of distinct elements of X, their 
images under f are also distinct. Thus, f is one-to-one if and only if for all x and x’ in X, the 
following implication holds: 


Lf) = f°) > [x= 2"). 


If f is both surjective and injective, it is called bijective or a one-to-one correspondence. In this case, 
for any y € Y, there exists a unique element x € X such that f(x) = y. This element x is then denoted 
by f-!(y). In this way, we already built a function from Y to X called the inverse of f. 
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Theorem 1.2.1 Let f: X — Y. If there are two functions g: Y > X and h: Y — X such that 
e(f(x)) =x for every x € X and f(h(y)) = y for every y € Y, then f is bijective and g =h=f—!. 


Proof: First we prove that f is surjective. Let y € Y and set x = h(y). Then, from the assumption on 
h, we have f(x) = f(h(y)) =y. This shows that f is surjective. 

Next we prove that f is injective. Let x,x’ € X be such that f(x) = f(x’). Then x = g(f(x)) = 
g(f(x’)) =’. Thus, f is injective. 

We have shown that for each y € Y, there is a unique x € X, which we denote f—!(y) such that 
f(x) =y. Since for such a y, g(y) = g(f(x)) =x, we obtain g(y) = f-!(y). Since f(A(y)) =y, we 
also conclude that h(y) =x = f(y). 


» Example 1.2.1 Consider the function f: (1,2] > [3,4) given by f(x) = 4—(x—1)?. We show 
that f is bijective. First let x,y € (1,2] be such that f(x) = f(y). That is, 4—(x—1)? =4—(y—1)?. 
Then (x— 1)? = (y—1)?. Since both x > 1 and y > 1, we conclude that x — 1 = y—1 and, so, x =y. 
This proves f is injective. 

Next let y € [3,4). We want x € (1,2] such that f(x) = y. Let us set up 4— (x— 1)? = y and 
solve for x. We get, x = ,/4—y+ 1. Note that since y < 4, y—4 has a square root. Also note that 
since 3 < y < 4, we have 1 > 4—y > O and, hence, 2 > /4—y+1 > 1. Therefore, x € (1,2]. This 
proves f is surjective. 


Definition 1.2.3 Let f: X — Y be a function and let A be a subset of X. Then the image of A under 
f is given by 

f(A) = {f(a) sa € A}. 
It follows from the definition that 


f(A) ={b © Y :b= f(a) for some ae A}. 


Moreover, f is surjective if and only if f(X) =Y. 
For a subset B of Y, the preimage of B under f is defined by 


fF \(B) = {x EX: f(x) ] B}. 


Remark 1.2.2 Note that, despite the notation, the definition of preimage does not require the 
function to have an inverse. It does not even require the function to be injective. The examples below 
illustrate these concepts. 

« Example 1.2.2 Let f: R— R be given by f(x) = 3x—1. Let A = [0,2) and B = {1,—4,5}. 
Then f(A) = [-1,5) and f~'(B) = {§,—1,2}. 

« Example 1.2.3 Let f: R— R be given by f(x) = —x+7. Let A = [0,2) and B = (—-,3]. Then 
f(A) = (5,7] and f~'(B) = [4,°). 

» Example 1.2.4 Let f: R — R be given by f(x) = x*. Let A = (—1,2) and B= [1,4). Then 
f(A) = [0,4) and f-'(B) = (—2,—1] U[I,2). 


Theorem 1.2.3 Let f: X — Y be a function, let A be a subset of X, and let B be a subset of Y. The 
following hold: 


(a) AC f!(f(A)). 


(b) f(f-'(B)) CB. 


Proof: We prove (a) and leave (b) as an exercise. 
(a) Let x € A. By the definition of image, f(x) € f(A). Now, by the definition of preimage, 
xe f-'(f(A)). 


Theorem 1.2.4 Let f: X — Y bea function, let A,B C X, and let C,D CY. The following hold: 


(a) IfC CD, then f-!(C) c f-!(D); 
(b) fF '(D\C)=fTD)\ FIO): 
(c) IfA CB, then f(A) C f(B); 

(d) f(A\B) D f(A) \ f(B). 


Proof: We prove (b) and leave the other parts as an exercise. 
(b) We prove first that f~'(D\C) c f-!(D) \ f-1(C). Let x € f-'(D\C). Then, from the 
definition of inverse image, we get f(x) € D\C. Thus, f(x) € D and f(x) ¢ C. Hence x € f~!(D) 
and x ¢ f-'(C). We conclude that x € f~!(D)\ f-1(C). 
Next we prove f—!(D)\ f-'(C) c f-!(D\C). Let x € f-!(D)\ f-1(C). Thus, x € f-!(D) and 
x f—'(C). Therefore, f(x) € D and f(x) ¢ C. This means f(x) € D\C and, so, x € f~!(D\C). 


Theorem 1.2.5 Let f: X — Y bea function, let {Aq}qey be an indexed family of subsets of X, and 
let {Bg }gcy be an indexed family of subsets of Y. The following hold: 


(a) f(UaerAa) = Uaer f(Aa): 
(b) f(NaerAa) C Neer f(A); 
(c) f~'(Upes Ba) = User | (Bp): 
(d) f-'(AperBs) =Npes f | (Bp): 


Proof: We prove (a) and leave the other parts as an exercise. 

(a) Let y € f(UgerAa). From the definition of image of a set, there is x € Uge;Aa such that 
y = f(x). From the definition of union of a family of sets, there is Q& € J such that x € Ag,. Therefore, 
y= f(x) € f(Aay) and, s0, y € Uger f(Aa). 


Given functions f: X — Y and g: Y — Z, we define the composition function go f of f and g 
as the function go f: X — Z given by 


(go f)(x) = g(f(x)) for allxe X. 


Theorem 1.2.6 Let f: X — Y and g: Y — Z be two functions and let B Cc Z. The following hold: 


(a) (sof) '(B) =f '(g'(B)); 

(b) If f and g are injective, then go f is injective; 
(c) If f and g are surjective, then go f is surjective; 
(d) If go f is injective, then f is injective; 


(e) If go f is surjective, then g is surjective. 
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Proof: We prove (d) and leave the other parts as an exercise. 

(d) Suppose go f is injective and let x,x’ € X be such that f(x) = f(x’). Then (go f)(x) = 
g(f(x)) =a(f()) = (go f)(x’). Since go f is injective, it follows that x = x’. We conclude that f 
is injective. O 


Definition 1.2.4 A sequence of elements of a set A is a function with domain N and codomain A. 
We discuss sequences in detail in Chapter 2. 


Definition 1.2.5 We say that set A is finite if it is empty or if there exists a natural number n and a 
one-to-one correspondence f: A — {1,2,...,n}. A set is infinite if it is not finite. 

We leave it as an exercise to prove that the union of two finite sets is finite. It is also easy to show, 
by contradiction, that N is infinite. The following result will be useful when studying sequences and 
accumulation points. 


Theorem 1.2.7 Suppose A is an infinite set. Then there exists a one-to-one function f: N — A. 


Proof: Let A be an infinite set. We define f as follows. Choose any element a; € A and set f(1) =a). 
Now the set A \ {a1} is again infinite (otherwise A = {a} U(A \ {a1}) would be the union of two 
finite sets). So we may choose az € A with ay # a, and we define f(2) = a’. Having defined 
f(\),...,f(k), we choose ax,,; € A such that ay,; € A \ {a),...,a,} and define f(k +1) = agi 
(such an a;,+1 exists because A \ {a),...,a,} is infinite and, so, nonempty). The function f so defined 
clearly has the desired properties. 


To paraphrase, the previous theorem says that in every infinite set we can find a sequence made 
up of all distinct points. 


Exercises 
1.2.1 » Let f: X — Y bea function. Prove that: 


(a) If f is one-to-one, then A = f—!(f(A)) for every subset A of X. 
(b) If f is onto, then f(f~!(B)) = B for every subset B of Y. 


1.2.2 Let f: R— R be given by f(x) =x” —3 and let A = [—2, 1) and B= (—1,6). Find f(A) and 
f"(B). 


1.2.3. Prove that each of the following functions is bijective. 
(a) f: (—0,3] + [-2,e) given by f(x) = |x—3]—2. 


(b) g: (1,2) + (3,00) given by g(x) = 


x-1 


1.2.4 Prove that if f: X — Y is injective, then the following hold: 


(a) f(ANB) = f(A) f(B) for A,B CX. 
(b) f(A\B) = f(A) \ f(B) for A,B CX. 


1.2.5 Prove part (2) of Theorem 1.2.3. 


>This fact relies on a basic axiom of set theory called the Axiom of Choice. See [Lay 13] for more details. 


1.3 


1.2.6 Prove parts (1), (3), and (4) of Theorem 1.2.4. 
1.2.7 Prove parts (2), (3), and (4) of Theorem 1.2.5. 
1.2.8 Prove parts (1), (2), (3), and (5) of Theorem 1.2.6. 


1.2.9 Prove that the union of two finite sets is finite. Hint: it is easier to show when the sets are 
disjoint. 


THE NATURAL NUMBERS AND MATHEMATICAL INDUCTION 


We will assume familiarity with the set N of natural numbers, with the usual arithmetic operations 
of addition and multiplication on N, and with the notion of what it means for one natural number to 
be less than another. 

In addition, we will also assume the following property of the natural numbers. 
Well-Ordering Property of the Natural Numbers: If A is a nonempty subset of N, then there 
exists an element @ € A such that @ < x for all x € A. 

To paraphrase the previous property, every nonempty subset of positive integers has a smallest 
element. 

The principle of mathematical induction is a useful tool for proving facts about sequences. 


Theorem 1.3.1 — Principle of Mathematical Induction. For each natural number n € N, suppose 
that P(n) denotes a proposition which is either true or false. Let A = {n € N:: P(n) is true}. Suppose 
the following conditions hold: 


(a) LEA. 
(b) For eachk EN, ifk € A, thenk+1€A. 


Then A = N. 


Proof: Suppose conditions (a) and (b) hold. Assume, by way of contradiction, that A 4 N. Set 
B=N\A, that is, B= {n © N: P(n) is false}. Then B is a nonempty subset of N. By the Well- 
Ordering Property of the natural numbers, there exists a smallest element ¢ € B. By condition (a), 
1 ¢ B. Hence, ¢ > 2. It follows that k = @— 1 is a natural number. Since k < @, k ¢ B and, hence, we 
have that P(k) is true. By condition (b), we obtain that P(k+ 1) is true. But k+ 1 = Z@, and P(£) is 
false, since £ € B. This is a contradiction, so the conclusion follows. 


To paraphrase, the principle says that, given a list of propositions P(n), one for each n EN, if 
P(1) is true and, moreover, P(k + 1) is true whenever P(k) is true, then all propositions are true. 

We will refer to this principle as mathematical induction or simply induction. Condition (a) above 
is called the base case and condition (b) the inductive step. When proving (b), the statement P(k) is 
called the inductive hypothesis. 


a Example 1.3.1 Prove using induction that for all n € N 


1 
14 24--tn MO ) 


n(n+1) 
“3 


(1+1) 


The statement P(n) is the equality 1+2+---+n= Now the base case says that 1 = : a 


which is clearly true. 
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Suppose P(k) is true for some k € N. That is, suppose that 1+ 2+---+k= ula (this is the 
inductive hypothesis). Now we have 
k(k+1 k(k+1)+2(k+1 k+1)(kK+2 
POA cng gel) = Ot) et) = ua AAT) Ee er) 


This shows that P(k+ 1) is true. We have now proved conditions (a) and (b) of Theorem 1.3.1. 
Therefore, by the principle of mathematical induction we conclude that 


n(n+1) 
2 


(9s = forallneN. 


= Example 1.3.2 Prove using induction that for all n € N, 7” — 2” is divisible by 5. 


For n = 1, we have 7 — 2 = 5, which is clearly a multiple of 5. 
Suppose that 7‘ — 2" is a multiple of 5 for some k € N. That is, there is an integer j such that 


7‘ — 2k — 57. Let us write 7‘ = 2 + 57. Now, substituting this expression below, we have 


Toth okt] — 7.7% 9.9% = 7(2* 4.5 7) — 2.2 = 7.2 2.9% 4.9.57 = 2*(7 2) 45-7) =5(2*4+-7)). 


It follows that 7+! — 2*+! is a multiple of 5. This proves the inductive step. 
We conclude by induction that 7” — 2” is divisible by 5 for alln € N. 


a Example 1.3.3 Prove using induction that for alln € N 
n+1<2" 


For n = 1, we have 1+ 1 = 2 =2!, so the base case is true. 
Suppose next that k+1 < 2* for some k € N. Thenk+1+1 <2*+1. Since 2‘ is a positive 
integer, we also have 1 < 2*. Therefore, 


Gebiyl <2" 21 <4 9. = Ot, 


We conclude by the principle of mathematical induction that n+ 1 < 2” foralln EN. 

The following result is known as the Generalized Principle of Mathematical Induction. It simply 
states that we can start the induction process at any integer mg, and then we obtain the truth of all 
statements P(n) for n > no. 


Theorem 1.3.2 — Generalized Principle of Mathematical Induction. Let mg € N and for each 
natural n > no, suppose that P(n) denotes a proposition which is either true or false. Let A = {n € 
N : P(n) is true}. Suppose the following two conditions hold: 


(a) no EA. 
(b) For eachk EN, k > no, ifk € A, thenk+1 €A. 


Then {k EN:k >n0} CA. 


Proof: Suppose conditions (a) and (b) hold. Assume, by way of contradiction, that A Z {k EN: 
k>no}. Set B={n€N:n>no,P(n) is false}. Then B is a nonempty subset of N. By the Well- 
Ordering Property of the natural numbers, there exists a smallest element  € B. By condition (a), 
no € B. Hence, ¢ > no +1. It follows that k = 2—1 > no. Since k < , k ¢ B and, so, we have that 
P(k) is true. By condition (b), we obtain that P(k + 1) is true. Butk+ 1 = @, and P(£) is false, since 
© B. This is a contradiction, so the conclusion follows. 
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= Example 1.3.4 Prove by induction that 3n < 2” for alln > 4. 
The statement is true for n = 4 since 12 < 16. Suppose next that 3k < 2 for some k € N, k > 4. 
Now, 


3(k+1) =3k4+3 < 243 <2 42% — 9K (1.1) 


where the second inequality follows since k > 4 and, so, 2k > 16 > 3. This shows that P(k +1) is 
true. Thus, by the generalized principle of induction, the inequality holds for all n > 4. 


Next we present another variant of the induction principle which makes it easier to prove the 
inductive step. Despite its name, this principle is equivalent to the standard one. 


Theorem 1.3.3 — Principle of Strong Induction. For each natural n € N, suppose that P(n) denotes 
a proposition which is either true or false. Let A = {n € N:: P(n) is true}. Suppose the following 
two conditions hold: 


(a) LEA. 
(b) For eachk EN, if 1,2,...,k € A, thenk+1€A. 


Then A = N. 


Remark 1.3.4 Note that the inductive step above says that, in order to prove P(k + 1) is true, we 
may assume not only that P(k) is true, but also that P(1), P(2),...,P(k — 1) are true. 
There is also a generalized version of this theorem where the base case is for some integer no > 1. 


a Example 1.3.5 Prove by induction that every positive integer greater than | is either a prime 
number or a product of prime numbers. 

Clearly, the statement is true for n = 2. Suppose the statement holds for any positive integer 
m€ {2,...,k}, where k EN, k > 2. If k+ 1 is prime, the statement holds for k+ 1. Otherwise, 
there are positive integers p,g > 1 such thatk+ 1 = pq. Since p,q < k, by the inductive assumption 
applied to both p and g we can find prime numbers r),...,7¢ and s1,...,5, such that p =7r,---r¢ and 
qd = $1 +++Sm (note that 2 and m may both equal 1). But then 


K+1L=ryp-++r¢s, +++ Sm. (1.2) 
Thus, the statement holds true for k+ 1. The conclusion now follows by the Principle of Strong 


Induction. 


Exercises 


1.3.1 Prove the following using Mathematical Induction. 


(a) 174+2?4-.-4+n?= cae’ for alln EN. 
(b) 13423 4---+73 = Mt" for alln EN. 


(c) 1+3+---+(2n—1) =n’ foralln EN. 
1.3.2 Prove that for all n € N, 9” — 5” is divisible by 4. 


1.3.3 Prove that for all n € N, 7” — 1 is divisible by 3. 
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1.3.4 Prove the following using induction. 


(a) 2n+1<2" forn>3(nEN). 


(b) n* <3" foralln EN. (Hint: show first that for all n € N, 2n < n* +1. This does not require 
induction.) 


(c) n° <3” for all n € N. (Hint: Check the cases n = 1 andn = 2 directly and then use induction 
for n > 3.) 


1.3.5 Given a real number a ¥ 1, prove that 


1— q'*! 
lta+a’+---+a"= for alln EN, 
1.3.6 » The Fibonacci sequence is defined by 
a, =a,=1 and Gn42 = 4n41+4p forn > 1. 


Prove that 


AS -(E91 


1.3.7 Let a > —1. Prove by induction that 
(1+a)" >1-+na forallneN. 


1.3.8 > Let a,b € R andn € N. Use Mathematical Induction to prove the binomial theorem 


oro £ ("eons 


k=0 


wher ae a 
Nk) (in 


ORDERED FIELD AXIOMS 


In this book, we will start from an axiomatic presentation of the real numbers. That is, we 
will assume that there exists a set, denoted by R, satisfying the ordered field axioms, stated below, 
together with the completeness axiom, presented in the next section. In this way we identify the 
basic properties that characterize the real numbers. After listing the ordered field axioms we derive 
from them additional familiar properties of the real numbers. We conclude the section with the 
definition of absolute value of a real number and with several results about it that will be used often 
later in the text. 

We assume the existence of a set R (the set of real numbers) and two operations + and - (addition 
and multiplication) assigning to each pair of real numbers x, y, unique real numbers x + y and x- y 
and satisfying the following properties: 


(la) (x+y) +z=x+(y+z) for all x,y,z ER. 
(1b) x+-y=y+x forall x,yER. 
(1c) There exists a unique element 0 € R such that x +0 =x for allx € R. 


(1d) For each x € R, there exists a unique element —x € R such that x + (—x) =0. 


(2a) (x-y)-z=x-(y-z) forall x,y,zER. 
(2b) x-y=y-x forallx,yER. 
(2c) There exists a unique element | € R such that 1 £0 and x- 1 =~ for allx € R. 


(2d) For each x € R \ {0}, there exists a unique element x! € R such that x- (x~!) = 1. (We also 
write 1 /x instead of x~!.) 


(2e) x-(y+z) =x-y+x-z for all x,y,z ER. 


We often write xy instead of x- y. 


In addition to the algebraic axioms above, there is a relation < on R that satisfies the order 
axioms below: 


(3a) For all x,y € R, exactly one of the three relations holds: x = y, y < x, orx < y. 
(3b) For all x,y,z € R, if x < y and y < z, then x < z. 

(3c) For all x,y,z € R, if x < y, thenx+z<y+z. 

(3d) For all x,y,z € R, if x < y and 0 < z, then xz < yz. 


We will use the notation x < y to mean x < y or x = y. We may also use the notation x > y to 
represent y < x and the notation x > y to mean x > yorx=y. 

A set F together with two operations + and - and a relation < satifying the 13 axioms above is 
called an ordered field. Thus, the real numbers are an example of an ordered field. Another example 
of an ordered field is the set of rational numbers Q with the familiar operations and order. The 
integers Z do not form a field since for an integer m other than 1 or —1, its reciprocal 1/m is not an 
integer and, thus, axiom 2(d) above does not hold. In particular, the set of positive integers N does 
not form a field either. As mentioned above the real numbers R will be defined as the ordered field 
which satisfies one additional property described in the next section: the completeness axiom. 

From these axioms, many familiar properties of IR can be derived. Some examples are given 
in the next proposition. The proof illustrates how the given axioms are used at each step of the 
derivation. 


Proposition 1.4.1 For x,y,z € R, the following hold: 


(a) Ifx+y=x-+z, then y = z; 

(b) —(—x) =x; 

(c) Ifx #0 and xy = xz, then y= z; 

(d) Ifx £0, then 1/(1/x) =x; 

(e) Ox =0=x0; 

(f) —x = (-1)s; 

(g) x(—z) = (—x)z = —(xz). 

(h) If x > 0, then —x < 0; if x < 0, then —x > 0; 
G) Ifx < yandz <0, then xz > yz; 

g) O<1. 
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Proof: (a) Suppose x+ y = x+ z. Adding —x (which exists by axiom (2d)) to both sides, we have 
(—x) + (x+y) = (—x) + (x +2). 
Then axiom (1a) gives 
[(—x) +a] +y = [(-x) +4] +z. 
Thus, again by axiom (2d), 0+ y=0+z and, by axiom (lc), y= z. 
(b) Since (—x) +x = 0, we have (by uniqueness in axiom (2d)) —(—x) =x. 
The proofs of (c) and (d) are similar. 
(ec) Using axiom (2e) we have 0x = (0+ 0)x = 0x+0x. Adding —(0x) to both sides (axiom (2d)) 
and using axioms (1a) and (1c), we get 
0 = —(Ox) + Ox = —(Ox) + (Ox + Ox) = (—(Ox) + Ox) + Ox = 0+ Ox = Ox. 
That Ox = x0 follows from axiom (2b). 
(f) Using axioms (2c) and (2e) we get x+ (—1)x = Ix+ (—1)x = (1+ (—1))x. From axiom (2d) 


we get 1+ (—1) =0 and from part (ec) we get x+ (—1)x = Ox = 0. From the uniqueness in axiom (2d) 
we get (—1)x = —x as desired. 


(g) Using axioms (2e) and (1c) we have xz + x(—z) = x(z¢+(—z)) =x0 = 0. Thus, using 
axiom (2d) we get that x(—z) = —(xz). The other equality follows similarly. 

(h) From x > 0, using axioms (3c) and (Ic) we have x+ (—x) > 0+ (—x) = —x. Thus, using 
axiom (2d), we get 0 > —x. The other case follows in a similar way. 


(i) Since z < 0, by part (h), —z > 0. Then, by axiom (3d), x(—z) < y(—z). Combining this with 
part (g) we get —xz < —yz. Adding xz + yz to both sides and using axioms (1a), (3c), (1b), and (1c) 
we get 


xy = (—xz+xz) +axy = —xz+ (xz+xy) < —xyt (xz-+xy) = —xyt+ (xy-+x2) = (—xy+xy) +22 = xz. 


(j) Axiom (2c) gives that 1 4 0. Suppose, by way of contradiction, that 1 < 0. Then by part (1), 
1-1>0-1. Since 1-1 = 1, by axiom (2c) and 0-1 =0 by part (e), we get 1 > 0 which is a 
contradiction. It follows that 1 > 0. 


Note that we can assume that the set of all natural numbers is a subset of IR (and of any ordered 
field, in fact) by identifying the 1 in N with the 1 in axiom (2c) above, the number 2 with 1+ 1, 3 
with 1+ 1+ 1, etc. Furthermore, since 0 < 1 (from part (j) of the previous proposition), axiom (3c) 
gives, | < 2 < 3, etc (in particular all these numbers are distinct). In a similar way, can include Z 
and Q as subsets. 

We say that a real number x is irrational if x € R \ Q, that is, if it is not rational. 


Definition 1.4.1 Given x € R, define the absolute value of x by 


x, if x > 0; 
|x| = 
—x, ifx<0. 
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Figure 1.1: The absolute value function. 


The following properties of absolute value follow directly from the definition. 


Proposition 1.4.2 Let x,y,M € R and suppose M > 0. The following properties hold: 


(a) |x| > 0; 
(b) | —x| = |x|; 
(c) |xy| = [ally]; 


(d) |x| <M if and only if —M <x < M. (The same holds if < is replaced with <.) 


Proof: We prove (d) and leave the other parts as an exercise. 
(d) Suppose |x| < M. In particular, this implies M > 0. We consider the two cases separately: 
x > 0 and x < 0. Suppose first x > 0. Then |x| =x and, hence, —M < 0 < x= |x| <M. Now suppose 
x <0. Then |x| = —x. Therefore, —x < M and, so x > —M. It follows that -M <x<0<M. 
For the converse, suppose —M < x < M. Again, we consider different cases. If x > 0, then 
|x| =x <M as desired. Next suppose x < 0. Now, —M < x implies M > —x. Then |x| = —x < M. 


Note that as a consequence of part (d) above, since |x| < |x| we get —|x| <x < |x]. 
The next theorem will play an important role in the study of limits. 


Theorem 1.4.3 — Triangle Inequality. Given x,y € R, 
Jx+yl] < |x| +[y]- 

Proof: From the observation above, we have 
-|x] <x < |x| 


—bl <y<hyl. 
Adding up the inequalities gives 


—|x|—|y| < x+y < |x|+]p]. 
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Since —|x|— |y| = —(|x| + |y]), the conclusion follows from Proposition 1.4.2 (d). 
Corollary 1.4.4 For any x,y € R, 
IIx] — Iyl]l < ley. 


Remark 1.4.5 The absolute value has a geometric interpretation when considering the numbers in 
an ordered field as points on a line. The number |a| denotes the distance from the number a to 0. 
More generally, the number d(a,b) = |a— b| is the distance between the points a and b. It follows 
easily from Proposition |.4.2 that d(x,y) > 0, and d(x,y) = 0 if and only if x = y. Moreover, the 
triangle inequality implies that 


d(x,y) < d(x,z) +d(z,y), 


for all numbers x, y, z. 


Exercises 


1.4.1 Prove that n is an even integer if and only if n* is an even integer. (Hint: prove the “if” part 
by contraposition, that is, prove that if n is odd, then n” is odd.) 


1.4.2 Prove parts (c) and (d) of Proposition 1.4.1 

1.4.3 Let a,b,c,d € R. Suppose 0 < a < band 0 < c < d. Prove that ac < bd. 
1.4.4 Prove parts (a), (b), and (c) of Proposition 1.4.2. 

1.4.5 » Prove Corollary 1.4.4. 

1.4.6 Given two real numbers x and y, prove that 


xt+tyt+|x—y| 
5) 


1.4.7 Let x,y,M € R. Prove the following 


A y=|e=)| 


max{x,y} = 5 


and min{x,y} = 


(a) |x|? = 2°. 


(b) |x| < M if and only if x < M and —x < M. 
(c) |x+y| = |x| +|y| if and only if xy > 0. 
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There are many examples of ordered fields. However, we are interested in the field of real 
numbers. There is an additional axiom that will distinguish this ordered field from all others. In 
order to introduce our last axiom for the real numbers, we first need some definitions. 


Definition 1.5.1 Let A be a subset of R. A number M is called an upper bound of A if 
x <M forall x EA. 


If A has an upper bound, then A is said to be bounded above. 
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Similarly, a number L is a lower bound of A if 
L<xforallx€A, 


and A is said to be bounded below if it has a lower bound. We also say that A is bounded if it is both 
bounded above and bounded below. 

It follows that a set A is bounded if and only if there exist M € R such that |x| < M for allxe A 
(see Exercise 1.5.1). 


Definition 1.5.2 Let A be a nonempty set that is bounded above. We call a number @ a least upper 
bound or supremum of A, if 


(1) x < @ for all x € A (that is, @ is an upper bound of A); 
(2) If M is an upper bound of A, then a < M (this means a@ is smallest among all upper bounds). 

It is easy to see that if A has a supremum, then it has only one (see Exercise |.5.2). In this case, 
we denote such a number by supA. 


= Example 1.5.1 


(a) sup[0,3) = sup[0, 3] = 3. 
First consider the set [0,3] = {x € R:0 <x < 3}. By its very definition we see that for all 
x € [0,3], x < 3. Thus 3 is an upper bound. This verifies condition (1) in the definition of 
supremum. Next suppose M is an upper bound of [0,3]. Since 3 € [0,3], we get 3 < M. This 
verifies condition (2) in the definition of supremum. It follows that 3 is indeed the supremum 
of [0,3]. 
Consider next the set [(0,3) = {x € R:0 <x < 3}. It follows as before that 3 is an upper bound 
of [0,3). Now suppose that M is an upper bound of [0,3) and assume by way of contradiction 
that 3 > M. If 0 > M, then M is not an upper bound of [0,3) as 0 is an element of [0,3). If 
O0<M, setx= Me Then 0 < x <3 and x > M, which shows M is not an upper bound of 
(0,3). Since we get a contradiction in both cases, we conclude that 3 < M and, hence, 3 is the 
supremum of [{0,3). 
sup{3,5,7,8, 10} = 10. 
Clearly 10 is an upper bound of the set. Moreover, any upper bound M must satisfy 10 < M as 
10 is an element of the set. Thus 10 is the supremum. 
n 
(c) sup{ iD) in ent a a 
n 2 
Note that if n € N is even, then n > 2 and 


(b 


wm 


n 
(1) aa 
n n 2 
If n € N is odd, then 
-1)" -I1 1 
( ae 
n n 2 


This shows that 5 is an upper bound of the set. Since 5 is an element of the set, it follows as 
in the previous example that 5 is the supremum. 

(d) sup{x?: -2<x<1,xeER}=4. 
Set A = {x*:-2<x<1,x€R}. If y€A, then y = x? for some x satisfying —2 < x < 1 and, 
hence, |x| < 2. Therefore, y = x” = |x|? < 4. Thus, 4 is an upper bound of A. Suppose M is 
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an upper bound of A but M@ < 4. Choose a number y € R such that M < y< 4and0 < y. Set 
x= —,/y. Then —2 <x <0< 1 and, so, y= x? € A. However, y > M which contradicts the 
fact that M is an upper bound. Thus 4 < M. This proves that 4 = supA. 


The following proposition is convenient in working with suprema. 


Proposition 1.5.1 Let A be a nonempty subset of R that is bounded above. Then @ = supA if and 
only if 


(1’) x< aq forall x € A; 
(2’) For any € > 0, there exists a € A such that @ — € <a. 


Proof: Suppose first that @ = supA. Then clearly (1’) holds (since this is identical to condition (1) 
in the definition of supremum). Now let € > 0. Since @ — € < @, condition (2) in the definition of 
supremum implies that @ — € is not an upper bound of A. Therefore, there must exist an element a 
of A such that a — € < aas desired. 

Conversely, suppose conditions (1”) and (2’) hold. Then all we need to show is that condition (2) 
in the definition of supremum holds. Let M be an upper bound of A and assume, by way of con- 
tradiction, that M < a. Set € = a—M. By condition (2) in the statement, there is a € A such that 
a>a—é=M. This contradicts the fact that M is an upper bound. The conclusion now follows. 


The following is an axiom of the real numbers and is called the completeness axiom. 


The Completeness Axiom. Every nonempty subset A of R that is bounded above has a least upper 
bound. That is, supA exists and is a real number. 


This axiom distinguishes the real numbers from all other ordered fields and it is crucial in the 
proofs of the central theorems of analysis. 
There is a corresponding definition for the infimum of a set. 


Definition 1.5.3 Let A be a nonempty subset of R that is bounded below. We call a number B a 
greatest lower bound or infimum of A, denoted by B = infA, if 


(1) x > B for all x € A (that is, B is a lower bound of A); 
(2) If N is a lower bound of A, then B > N (this means f is largest among all lower bounds). 


Using the completeness axiom, we can prove that if a nonempty set is bounded below, then its 
infimum exists (see Exercise |.5.5). 


= Example 1.5.2 
(a) inf(0,3] = inf[0, 3] = 0. 
(b) inf{3,5,7,8, 10} = 3. 


(c) int nen} =-—1. 


1 
(d) inf{1+-—:neEN}=1. 
n 
(e) inf{x* : -2<x<1,xeER}=0. 
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The following proposition is useful when dealing with infima and its proof is completely 
analogous to that of Proposition 1.5.1. 


Proposition 1.5.2 Let A be a nonempty subset of R that is bounded below. Then B = infA if and 
only if 

(1’) x> B for all x € A; 

(2’) For any € > 0, there exists a € A such that a < B+€. 


The following is a basic property of suprema. Additional ones are described in the exercises. 


Theorem 1.5.3 Let A and B be nonempty sets and A C B. Suppose B is bounded above. Then 
supA < supB. 


Proof: Let M be an upper bound for B, then for x € B, x < M. In particular, it is also true that x << M 
for x € A. Thus, A is also bounded above. Now, since sup B is an upper bound for B, it is also an 
upper bound for A. Then, by the second condition in the definition of supremum, supA < supB as 
desired. 


It will be convenient for the study of limits of sequences and functions to introduce two additional 
symbols. 


Definition 1.5.4 The extended real number system consists of the real field IR and the two symbols 
co and —co, We preserve the original order in R and define 


—o mK < 00 


for every x € R 

The extended real number system does not form an ordered field, but it is customary to make the 
following conventions: 
(a) If x is areal number, then 


(b) If x > 0, then x-co = 00, x - (00) = —co, 
(c) If x < 0, then x-0o = —o0, — x- (—00) = 00, 
(d) 20 + 00 = co, —co-+ (—o0) = —00, 00-00 = (—00) - (—o0) = 00, and (—oe) - 00 = 00 - (—o0) = 
We denote the extended real number set by R. The expressions 0)- 0, 0¢ + (—ov), and (— a 
are left undefined. 
The set R with the above conventions will be convenient to describe results about limits in later 
chapters. 


Definition 1.5.5 If A 4 @ is not bounded above in R, we will write supA = -. If A is not bounded 
below in R, we will write infA = —9. 


With this definition, every nonempty subset of R has a supremum and an infimum in R. To 
complete the picture we adopt the following conventions for the empty set: sup @ = —co and 
inf 0 = c, 


Exercises 


1.5.1 Prove that a subset A of R is bounded if and only if there is M € R such that |x| < M for all 
Se: 
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1.5.2 Let A be a nonempty set and suppose @ and satisfy conditions (1) and (2) in Definition 1.5.2 
(that is, both are suprema of A). Prove that a = B. 


1.5.3 For each subset of R below, determine if it is bounded above, bounded below, or both. If it is 
bounded above (below) find the supremum (infimum). Justify all your conclusions. 


(a) {1,5,17} 
(b) [0,5) 


(c) 14+2F nen} 
n 


(d) (—3,e2) 

(e) {xE R: x? -3x+2=0} 
(f) {x -3x+2:xER} 
(g) {xE R: x —4x <0} 
(h) {x ER: 1 < |x| <3} 


1.5.4 » Suppose A and B are nonempty subsets of R that are bounded above. Define 
A+B={a+b:aceAandbe B}. 


Prove that A + B is bounded above and 


sup(A + B) = supA+ supB. 
1.5.5 Let A be a nonempty subset of R. Define —A = {—a:a€ A}. 


(a) Prove that if A is bounded below, then —A is bounded above. 
(b) Prove that if A is bounded below, then A has an infimum in R and infA = — sup(—A). 


1.5.6 Let A be a nonempty subset of R and ~ € R. Define @A = {aa:a€ A}. Prove the following 
statements: 


(a) If @ > 0 and A is bounded above, then @A is bounded above and sup@A = a supA. 
(b) If @ < 0 and A is bounded above, then @A is bounded below and inf “7A = a supA. 


1.5.7 Suppose A and B are nonempty subsets of R that are bounded below. Prove that A+ B is 
bounded below and 


inf(A + B) = infA + inf B. 
1.5.8 Let A,B be nonempty subsets of R that are bounded below. Prove that if A C B, then 


infA > infB. 


1.6 APPLICATIONS OF THE COMPLETENESS AXIOM 


We prove here several fundamental properties of the real numbers that are direct consequences 
of the Completeness Axiom. 
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Theorem 1.6.1 — The Archimedean Property. The set of natural numbers is unbounded above. 


Proof: Let us assume by contradiction that N is bounded above. Since N is nonempty, 
a = supN 
exists and is a real number. By Proposition 1.5.1 (with € = 1), there exists n € N such that 


a-l<n<a. 


But then n+ 1 > a. This is a contradiction since n+ 1 is a natural number. 


The following theorem presents several immediate consequences. 
Theorem 1.6.2 The following hold: 


(a) For any x € R, there exists n € N such that x < n; 

(b) For any € > 0, there exists n € N such that 1/n < €; 

(c) For any x > 0 and for any y € R, there exists n € N such that y < nx; 
(d) For any x € R, there exists m € Z such that m—1 <x < mm. 


Proof: (a) Fix any x € R. Since N is not bounded above, x cannot be an upper bound of N. Thus, 
there exists n € N such that x < n. 
(b) Fix any € > 0. Then 1/¢ is a real number. By (1), there exists n € N such that 


Liem 


This implies 1/n < €. 
(c) We only need to apply (a) for the real number y/x. 
(d) First we consider the case where x > 0. Define the set 


A={nEN:x<n}. 


From part (a), A is nonempty. Since A is a subset of N, by the Well-Ordering Property of the 

natural numbers, A has a smallest element @. In particular, x < ¢ and — 1 is not in A. Since £ € N, 

either —1 EN or €—1=0. If 2—1 EN, since 02—1 ¢A we get €—1 <x. If €—1 =0, we have 

&—1=0<-~x. Therefore, in both cases we have ¢— 1 < x < £ and the conclusion follows with m = @. 
In the case x < 0, by part (1), there exists N € N such that 


|x| <.N. 


In this case, —N <x <N,sox+WN > 0. Then, by the result just obtained for positive numbers, there 
exists a natural number k such that k—1<x+N <k. This implies 


k-N-1l<x<k—-N. 


Setting m =k —N, the conclusion follows. The proof is now complete. 
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« Example 1.6.1 Let A = sup{1— - :n © N}. We claim that supA = 1. 
We use Proposition 1.5.1. Since 1 — 1/n < 1 for alln € N, we obtain condition (1’). Next, let 
€ > 0. From Theorem 1.6.2 (b) we can find n € N such that 1 < €. Then 


1 
l-e<l—--. 
n 


This proves condition (2’) with a = 1— - and completes the proof. 


Theorem 1.6.3 — The Density Property of Q. If x and y are two real numbers such that x < y, then 
there exists a rational number r such that 


x<r<y. 
Proof: We are going to prove that there exist an integer m and a positive integer n such that 
x<m/n<y, 
or, equivalently, 
nx <m<ny=nx+n(y—x). 
Since y—x > 0, by Theorem 1.6.2 (3), there exists n € N such that 1 < n(y—x). Then 
ny =nx+n(y—x) >nx+1. 
By Theorem 1.6.2 (4), one can choose m € Z such that 
m—1<nx<m. 
Then nx << m<nx+1 < ny. Therefore, 


x<m/n<y. 


The proof is now complete. 


We will prove in a later section (see Examples 3.4.2 and 4.3.1) that there exists a (unique) 
positive real number x such that x7 = 2. We denote that number by 2. The following result shows, 
in particular, that R 4 Q. 


Proposition 1.6.4 The number V2 is irrational. 


Proof: Suppose, by way of contradiction, that /2 € Q. Then there are integers r and s with s 4 0, 
such that 
os 
V2=-. 
S 
By canceling out the common factors of r and s, we may assume that r and s have no common 


factors. 
Now, by squaring both sides of the equation above, we get 
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and, hence, 
2s? =P’, (1.3) 


It follows that r” is an even integer. Therefore, r is an even integer (see Exercise 1.4.1). We can then 
write r = 27 for some integer j. Hence r* = 4j*. Substituting in (1.3), we get s* = 2j*. Therefore, 
s” is even. We conclude as before that s is even. Thus, both r and s have a common factor, which is a 


contradiction. 


The next theorem shows that irrational numbers are as ubiquitous as rational numbers. 


Theorem 1.6.5 Let x and y be two real numbers such that x < y. Then there exists an irrational 
number ¢ such that 


X<t<y. 

Proof: Since x < y, one has 
x= v2 <y- v2 

By Theorem 1.6.3, there exists a rational number r such that 
x-V2<r<y-v2 

This implies 


x<crt+v2<y. 


Since r is rational, the number t = r+ V2 is irrational (see Exercise 1.6.4) and x <t < y. 


Exercises 


1.6.1 For each sets below determine if it is bounded above, bounded below, or both. If it is bounded 
above (below) find the supremum (infimum). Justify all your conclusions. 


(a) toainen} 
(b) {Cpt sinent 
(c) {( 1)" oF nen} 


1.6.2 » Let r be a rational number such that 0 < r < 1. Prove that there is n € N such that 
1 1 
r 


1 
1.6.3 Let x € R. Prove that for every n € N, there is r € Q such that |x—r| < -. 
n 
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1.6.4 Prove that if x is a rational number and y is an irrational number, then x + y is irrational. What 
can you say about xy? 


1.6.5 Prove that in between two real numbers a and b with a < J, there are infinitely many rational 
numbers. 


1.6.6 Prove that in between two real numbers a and b with a < b, there are infinitely many irrational 
numbers. 
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CONVERGENCE 

LIMIT THEOREMS 

MONOTONE SEQUENCES 

THE BOLZANO-WEIERSTRASS THEOREM 

LIMIT SUPERIOR AND LIMIT INFERIOR 

OPEN SETS, CLOSED SETS, COMPACT SETS, AND LIMIT 
POINTS 


2. SEQUENCES 


We introduce the notion of limit first through sequences. As mentioned in Chapter 1, a sequence 
is just a function with domain N. More precisely, a sequence of elements of a set A is a function 
f: NA. We will denote the image of n under the function with subscripted variables, for example, 
dn = f(n). We will also denote sequences by {a,}”_,, {dn}n, or even {a,}. Each value a, is called 
a term of the sequence, more precisely, the n-th term of the sequence. 


a Example 2.0.1 Consider the sequence a, = 1 for n € N. This is a sequence of rational numbers. 
On occasion, when the pattern is clear, we may list the terms explicitly as in 
1111 
Py tah ge gee 
« Example 2.0.2 Let a, = (—1)" forn € N. This is a sequence of integers, namely, 
=1,1,=1,1,=—1,1,... 


Note that the sequence takes on only two values. This should not be confused with the two-element 
set {1,—1}. 


CONVERGENCE 


Definition 2.1.1 Let {a,,} be a sequence of real numbers. We say that the sequence {a,} converges 
toa € Rif, for any € > 0, there exists a positive integer N such that for any n € N with n > N, one 
has 

|ay — a| < € (or equivalently, a—€ < a, <a+€). 
In this case, we call a the limit of the sequence (see Theorem 2.1.3 below) and write lim, -,..d, = a. 
If the sequence {a,,} does not converge, we call the sequence divergent. 


Remark 2.1.1 It follows directly from the definition, using the Archimedean property, that a 
sequence {a,} converges to a if and only if for any € > 0, there exists a real number N such that for 
any n € N withn > N, one has 

lan —al <€. 
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a Example 2.1.1 Let a, = 1 for n € N. We claim that lim,_,.a, = 0. We verify it using the 
definition. Let € > 0. Choose an integer N > 1/e€. (Note that such an integer N exists due to the 
Archimidean Property.) Then, ifn > N, we get 


1 


n 


a Example 2.1.2 We now generalize the previous example as follows. Let @ > 0 and consider the 
sequence given by 


1 
On =~ torn EN. 


Let € > 0. Choose an integer N such that N > (A)¥e, For every n > N, one has n > (Ayl/e and, 
hence, n™ > i, This implies 


We conclude that lim,_,..d;, = 0. 


« Example 2.1.3 Consider the sequence {a, } where 


_ 3n? +4 
On nts 
We will prove directly from the definition that this sequence converges to ad = 3. 
Let € > 0. We first search for a suitable NV. To that end, we simplify and estimate the expression 


|a, —a|. Notice that 


7,3] = 3n°+4 3] |2(3n?+4)—3(2n?+n+5)| | -7-3n 
2)  |2n2+n4+5 2] 2(2n2+n+5) | 2(2n2+n+5) 
3n+7 10n 10 


< = : 
2(2n*+n+5) 4n? 4n 


10 
To guarantee that the last expression is less than €, it will suffice to choose N > re Indeed, ifn > N, 
we get 


10 _ 10 10 


< < = 
[an 1S a, Say <a 


« Example 2.1.4 Let {a,} be given by 


We claim lim) _,.<) dn = ¢ 

Let € > 0. We search for a suitable NV. First notice that 
= 4n—3 
~ |3(3n? —n) 


4n?-1 4 i" 12n? —3 —12n? +4n 
3n2—-n 3) 3(3n? —n) 
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Since n > 1, we have n? > n and 4n > 3. Therefore we have 


4n*-1 4 _ 4n-3 4n—3 4n 4 
3n2-n 3 


5 =n) SGre ae) on on 


Thus, if N > a, we have, for n > N 


< \ 
32 —n 3|\- on ON 


An? —1 ; 4 4 
< 


a Example 2.1.5 Consider the sequence given by 


— ws 
An +n 


Qn 
We prove directly from the definition that {a,} converges to i 
Let € > 0. Now, 
4n*+20—4n*—n| |[20—n| 


4(4n2 +n) 4(4n2 +n) 


If n > 20, then |20 —n| = n— 20. Therefore, for such n we have 


w+5 1 _ 
4n24+n 4| 


met+S 1/_ n-20, 2 _ 1 
4n2+n 4| 4(4n2+n)~ 16n2 16n' 


Choose N > max{7i=,20}. Then, for n > N we get 


nr+5 1 1 2 1 = 
4n2+n 4] 16n~7 16N ; 


The following result is quite useful in proving certain inequalities between numbers. 


Lemma 2.1.2 Let 2 > 0. If @ < € for all € > 0, then = 0. 


Proof: This is easily proved by contraposition. If £ > 0, then there is a positive number, for example 
€ = ¢/2, such that € < £. 


Theorem 2.1.3 A convergent sequence {a,,} has at most one limit. 


Proof: Suppose {a,} converges to a and b. Then given € > 0, there exist positive integers N, and 
N> such that 


|dn —a| < €/2 for alln > Ny 
and 

|an — b| < €/2 for alln > No. 
Let N = max{N,,N2}. Then 


|a—b| < |a—ay|+|ay —b| < €/2+€/2=€. 


Since € > 0 is arbitrary, by Lemma 2.1.2, |a— b| = 0 and, hence, a = b. 


The following lemma is a simple generalization of (2.1.2). 
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Lemma 2.1.4 Given real numbers a,b, then a < b if and only ifa < b+€ forall e > 0. 


Proof: Suppose a < b+ € for all € > 0. And suppose, by way of contradiction, that a > b. then set 
€& =a—b. Then &€ > 0. By assumption, we should have a < b+ & = b+a—b=a, whichis a 
contradiction. It follows that a < b. 

The other direction follows immediately from the order axioms. 


The following comparison theorem shows that (non-strict) inequalities are preserved “in the 
limit”. 


Theorem 2.1.5 — Comparison Theorem. Suppose {a,} and {b,} converge to a and b, respec- 
tively, and a, < b, for alln € N. Thena < b. 


Proof: For any € > 0, there exist Nj, N2 € N such that 


E E 

a—s Aes BS forn > N,, 
E E 

b- 7 <bn<bt+s, forn > No. 


Choose N > max{N;,N2}. Then 


E E 
—-= < b+. 
a 7 <n by < 5 


Thus, a << b+ € for any € > 0. Using Lemma 2.1.4 we conclude a < b. 


Theorem 2.1.6 — The Squeeze Theorem. Suppose the sequences {a,}, {b,}, and {c,} satisfy 
An < by < cy for alln Ee N, 


and limy-5o. dy = limy5.0.C, = ¢. Then lim,_5.b, = &. 


Proof: Fix any € > 0. Since lim,_,..d, = @, there exists Nj € N such that 
L-E<a,<l+eE 

for all n > N;. Similarly, since lim,_,..c, = @, there exists Nz € N such that 
at ae Ee ee 

for all n > Nz. Let N = max{N1,N2}. Then, for n > N, we have 


L-E< ay <lyn Sy < E+E, 


which implies |b, — ¢| < €. Therefore, limo. by = &. 


Definition 2.1.2 A sequence {a,} is bounded above if the set {a, :n € N} is bounded above. 
Similarly, the sequence {a, } is bounded below if the set {a, :n € N} is bounded below. We say that 
the sequence {a,} is bounded if the set {a, : n € N} is bounded, that is, if it is both bounded above 
and bounded below. 


It follows from the observation after Definition |.5.| that the sequence {a, } is bounded if and 
only if there is M € R such that |a,| < M for alln EN. 
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Theorem 2.1.7 A convergent sequence is bounded. 


Proof: Suppose the sequence {a,} converges to a. Then, for € = 1, there exists N € N such that 
|dn —a| < 1 foralln >N. 
Since |an|—|a| < ||an| —|a|| < |an — al, this implies |a,| << 1+|a| for alln > N. Set 


M = max{|aj|,...,|ay_1|,|a| +1}. 


Then |a,| < M for all € N. Therefore, {a,} is bounded. 


Definition 2.1.3 Let {a,}"_, be a sequence of real numbers. The sequence {b,}"_, is called a 
subsequence of {a,}"_, if there exists a sequence of increasing positive integers 


nm<m << "::, 


such that by = ay, for each k € N. 


« Example 2.1.6 Consider the sequence a, = (—1)” forn EN. 
Then {a;} is a subsequence of {a,} and az, = 1 for all k (here n, = 2k for all k). Similarly, 
{a2x+41} is also a subsequence of {a,} and a2, = —1 for all k (here ng, = 2k+ 1 for all k). 


Lemma 2.1.8 Let {7}, be a sequence of positive integers with 
ny <n <1n3<::: 


Then n, > k for all k EN. 


Proof: We use mathematical induction. When k = 1, it is clear that n, > 1 since n, is a positive 
integer. Assume nz > k for some k. Now ng+1 > ng and, since nz and ng+1 are integers, this implies, 
N+) = Ne +1. Therefore, nz41 > k-+ 1 by the inductive hypothesis. The conclusion now follows by 
the principle of mathematical induction. 


Theorem 2.1.9 If a sequence {a,,} converges to a, then any subsequence {a,, } of {a,} also con- 
verges to a. 


Proof: Suppose {a,,} converges to a and let € > 0 be given. Then there exists N such that 
la, —a| < € foralln>N. 
For any k > N, since nz > k, we also have 


|@n, —a| < €. 


Thus, {day, } converges to a as k + , 


u Example 2.1.7 Let a, = (—1)" forn € N. Then the sequence {a,,} is divergent. Indeed, suppose 
by contradiction that 


lim a, = £. 
n—-eco 
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Then every subsequence of {a,} converges to a number £ € R. From the previous theorem, it follows, 
in particular, that 


= lim az, = 1 and €= lim agy4, = —- 1. 
k—so0 k—o0 


This contradiction shows that the sequence is divergent. 
Since the sequence {a, } is bounded but not convergent, this example illustrates the fact that the 
converse of theorem 2.1.7 is not true. 


Remark 2.1.10 Given a positive integer ko, it will be convenient to also talk about the sequence 
{4n}n>ky, that is, a function defined only for the integers greater than or equal to ko. For simplicity 
of notation, we may also denote this sequence by {a,} whenever the integer ko is clear from the 
context. For instance, we talk of the sequence {a,} given by 
n+1 
= > 
"~~ (n—1)(n—2) 

although a; and az are not defined. In all cases, the sequence must be defined from some integer 
onwards. 


Exercises 


2.1.1 Prove the following directly from the definition of limit. 


2n? +2 
(a) limy— co Cece | = 0. 
: n +1 1 
(b) limy +00 Fae me | =%5- 
. 2n3 +1 
(c) LiMy—+00 eo =H = 5 
3n° +5 1 
d) li aa = > 
( ) 1My-+ 6n2 +n 2 
2 
—1 
4 


(e) limp. —— = 
n — 


2.1.2 Prove that if {a,} is a convergent sequence, then {|a,|} is a convergent sequence. Is the 
converse true? 


2.1.3 Let {a,} be a sequence. Prove that if the sequence {|a,|} converges to 0, then {a,} also 
converges to 0. 


. sinn 
2.1.4 Prove that lim,_,.. —— = 0. 
n 


2.1.5 Let {x,} be a bounded sequence and let {y, } be a sequence that converges to 0. Prove that 
the sequence {x,y,} converges to 0. 


2.1.6 Prove that the following limits are 0. (Hint: use Theorem 2.1.6.) 


eh tin n+cos(n* — 3) 
noo Qn? +] 
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2 
(d) lim — 


noo 30° 


(Hint: see Exercise | .3.4(c)). 


2.1.7 Prove that if lim,_,..a, = & > 0, then there exists N € N such that a, > 0 for alln > N. 
2.1.8 > Prove that if lim,_,..d, = & 4 0, then lim,_,.. ee = 1. Is the conclusion still true if 2 = 0? 


2.1.9 Let {a,} be a sequence of real numbers such that lim,_,..d, = 3. Use Definition 2.1.1 to 
prove the following 


(a) lim 3a, —7 = 2; 
n—-co 
ced 


4 
(b) lim = 3° (Hint: prove first that there is N such that a, > 1 forn > N.) 
n—-eo an 


2.1.10 Let a, > 0 for all n € N. Prove that if lim,,..d, = @, then lim, 0 /@n = V2. 
2.1.11 Prove that the sequence {a,} with a, = sin(n7/2) is divergent. 


2.1.12 » Consider a sequence {a,}. 


(a) Prove that lim,_,..d, = @ if and only if limz_,.. dog = @ and limg_,.. d2x41 = &. 
(b) Prove that lim,-,.d, = @ if and only if limy_,.. a3, = @, limg 500 3x41 = &, and 
limp 500 43442 = &. 


2.1.13 Given a sequence {a,}, define a new sequence {b,} by 


aj +d2+...+an 
bn = : 


n 


(a) Prove that if lim,_,..a, = @, then lim,_,.. by, = £. 


(b) Find a counterexample to show that the converse does not hold in general. 


2.2 LIMIT THEOREMS 


We now prove several theorems that facilitate the computation of limits of some sequences in 
terms of those of other simpler sequences. 


Theorem 2.2.1 Let {a,} and {b,} be sequences of real numbers and let k be a real number. Suppose 
{a,} converges to a and {b,} converges to b. Then the sequences {a, +b,}, {kan}, and {a,by} 
converge and 


(a) limy5.0(dy + bn) =atb; 

(b) limy (kay) = ka; 

(c) limy+5.0(anbn) = ab; 

an 


(d) If in addition b ~ 0 and b, 4 0 for n € N, then { 5 } converges and lim,_,.. aa 


a 
b,  b 


n 
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Proof: (a) Fix any € > 0. Since {a,} converges to a, there exists N; € N such that 
E 
lan —a| < 5 for alln > Ni. 
Similarly, there exists N2 € N such that 
E 
|bn —B| < 5 for all n > Np. 


Let N = max{N),N2}. For any n > N, one has 


E E 
\(Gn + bn) —(a+b)| < |a, —a| + |b, — | < an) = €. 


Therefore, limy—,.0(dy + by) = a+b. This proves (a). 


(b) If k =0, then ka = 0 and ka, = 0 for all n. The conclusion follows immediately. Suppose 


£ 
next that k #0. Given € > 0, let N € N be such that |a, —a| < i for n > N. Then for n > N, 


|kay, — ka| = |k||a, —a| < €. It follows that lim,_,..(ka,) = ka as desired. This proves (b). 


(c) Since {a,} is convergent, it follows from Theorem 2.1.7 that it is bounded. Thus, there exists 
M > 0 such that 


lan] <M for alln EN. 
For every n € N, we have the following estimate: 
|anDn — ab| = |anbpy — dnb + ayb — ab| < \ay||by — b| + |b||an — al. (2.1) 


Let € > 0. Since {a,} converges to a, we may choose N; € N such that 


lan —a| < 5 for alln > Ny. 


E 
(Jb| + 1) 


Similarly, since {b,} converges to b, we may choose N2 € N such that 
\by —b| < —~ forall n > N. 
n IM all n — INd. 


Let N = max{N),N2}. Then, for n > N, it follows from (2.1) that 


E 


E 
b, —ab| <M b 
|an n—a | < ain | xqbi41) 


<eéforalln>N. 


Therefore, lim; ..d,b, = ab. This proves (c). 


(d) Let us first show that 


lim — =+ 
rao ~ p 
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Since {b,} converges to b, there is N; € N such that 
|bn —B| < ees 
n 5 AN 


[>| 
2 


b b 
[b| and, hence, Hal < |by|- 


b 


It follows (using a triangle inequality) that, for such n, 


For each n > N,, we have the following estimate 


(2.2) 


1 j= aH ad 
b, b| |bllb) Be 


Now let € > 0. Since lim,_,.. b, = b, there exists Ny € N such that 


b 
|bn —b| < ~ for all n > Np. 


Let N = max{N,,N2}. By (2.2), one has 


5| = be <€éforalln>N. 


1 1 2\bn — D| 


; 1 1 
It follows that lim,_,.. he = B 


Finally, we can apply part (c) and have 


. an . 1 a 
lim — = lima,— = — 
n—co by n—-eo by 


The proof is now complete. 


« Example 2.2.1 Consider the sequence {a,} given by 


_ 3n?—2n4+5 


= —______, 2.3 
1—4n+7n2 29) 


an 


Dividing numerator and denominator by n”, we can write 


3-2/n+5/n? 


~ 1/n2—4/n+7 eo 


an 


Therefore, by the limit theorems above, 


3-2/n+5/n? _ limy5.3—lim,+02/nt+lim,+0.5/n? 3 


_ = =—_, 2.5 
n—co neo 1 /n2—4/n+7 Vimy 5001 /n? —limy304/n+limy 07 7 


a Example 2.2.2 Let a, = Wb, where b > 0. Consider the case where b > 1. In this case, a, > 1 
for every n. By the binomial theorem, 


b=ay, = (an—1+4+1)" >1+n(a,—-1). 
This implies 


b-1 
a 


O<a,-1< 
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b-1 
For each € > 0, choose N > a It follows that for n > N, 


lan —-1]=a,-1< < <6 


Thus, limy,-5..d, = 1. 
In the case where b = 1, it is obvious that a, = 1 for all n and, hence, limy5..dy = 1. 


1 
If0<b <1, lete= => and define 


1 
Xn = We = 
an 
Since c > 1, it has been shown that lim,_,..x, = 1. This implies 
: | 
lim a, = lim — = 1. 
noo NO Xp 


Exercises 
2.2.1 Find the following limits: 


. 14+3n—n3 
(b) ee 3n3 — 2n2 +17 


2.2.2 Find the following limits: 


2.2.3 > Find the following limits if they exist: 
(a) limyy.0(Vn? +n—n). 


( 
(b) lim, 4.0.(Wn3 + 3n? — n). 
(c) limp s00(W/n3 + 3n2 — Vn? +n). 
( 
( 


(d) limy4.0(Vn+1— Vn). 


(e) limp 0(/n+1—/n)/n. 
2.2.4 Find the following limits. 
(a) For |r| < 1 and b ER, lim, .0(b + br+ br? +--+» +br"). 
p} 2 


2 
i) line ee pe |, 
ey Dit (otimt +i) 


2.2.5 Prove or disprove the following statements: 
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(a) If {a,} and {b,} are convergent sequences, then {a, + b,} is a convergent sequence. 
(b) If {an} and {b,} are divergent sequences, then {a, +b, } is divergent sequence. 

(c) If {a,} and {b,} are convergent sequences, then {a,,b,} is a convergent sequence. 
(d) If {a,} and {b,} are divergent sequences, then {a,b,} is a divergent sequence. 

(e) If {a,} and {a, + by} are convergent sequences, then {b,} is a convergent sequence. 


(f) If {a,} and {a, +b,} are divergent sequences, then {b,,} is a divergent sequence. 


2.3 MONOTONE SEQUENCES 


Definition 2.3.1 A sequence {a,} is called increasing if 
Qn < Gn+1 for alln EN. 


It is called decreasing if 


An > n+) for alln EN. 


If {a,} is increasing or decreasing, then it is called a monotone sequence. 

The sequence is called strictly increasing (resp. strictly decreasing) if dn < dn41 for alln € N 
(resp. dy > An+1 for alln € N). 

It is easy to show by induction that if {a,} is an increasing sequence, then a, < a, whenever 
n<m. 


Theorem 2.3.1 — Monotone Convergence Theorem. Let {a,,} be a sequence of real numbers. 
The following hold: 


(a) If {a,} is increasing and bounded above, then it is convergent. 


(b) If {a,} is decreasing and bounded below, then it is convergent. 


Proof: (a) Let {a,} be an increasing sequence that is bounded above. Define 
A=f{a,:nEN}. 


Then A is a subset of R that is nonempty and bounded above and, hence, supA exists. Let 2 = supA 
and let € > 0. By Proposition 1.5.1, there exists NV € N such that 


l—E<ay <b. 

Since {a,} is increasing, 
l-—E€ <ay <a, foralln>N. 

On the other hand, since / is an upper bound for A, we have a, < ¢ for all n. Thus, 
l—-€<a,<l+€ foralln>N. 


Therefore, lim,_,.. dy, = &. 
(b) Let {a,} be a decreasing sequence that is bounded below. Define 


by = —an. 
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Then {b,,} is increasing and bounded above (if M is a lower bound for {a,}, then —M is an upper 
bound for {b, }). Let 


£= lim b, = lim (—a,). 
n—oo N—yoo 


Then {a,} converges to —£ by Theorem 2.2.1. 


Remark 2.3.2 It follows from the proof of Theorem 2.3.1 that if {a,} is increasing and bounded 
above, then 

lim ay, = sup{a, :n € N}. 

n—-co 


Similarly, if {a,} is decreasing and bounded below, then 
lim a, = inf{a,:n EN}. 
n—00 
« Example 2.3.1 Given r € R with |r| < 1, define a, =r” forn € N. Then 


lim a, = 0. 
n—>0o 


This is clear if r = 0. Let us first consider the case where 0 < r < 1. Then 0 < dy4) =ray < a, for 
all n. Therefore, {a,} is decreasing and bounded below. By Theorem 2.3.1, the sequence converges. 
Let 


£= lim ay. 
n—oo 


Since d,41 = rd, for all n, taking limits on both sides gives ¢ = ré. Thus, (1 —r)¢ = 0 and, hence, 
¢ =O. In the general case, we only need to consider the sequence defined by b, = |a,| for n € N; see 
Exercise 2.1.3. 


« Example 2.3.2 Consider the sequence {a,} defined as follows: 


a =2 (2.6) 


5 
Gee tog (2.7) 


First we will show that the sequence is increasing. We prove by induction that for all n € N, 
Ay < An41. Since az ax j > 2 = ay, the statement is true form = 1. Next, suppose ay < ag41 
for some k € N. Then ag +5 < agy1 +5 and (ay +5)/3 < (ax41 +5)/3. Therefore, 


ae t+5 | agi +5 
= 8 


ak = = ak+2- 
It follows by induction that the sequence is increasing. 

Next we prove that the sequence is bounded by 3. Again, we proceed by induction. The statement 
is clearly true for n = 1. Suppose that a, < 3 for some k € N. Then 


WHFS 2845 8 2, 
3 ~ 3 37 


Akl = 


It follows that a, < 3 for alln EN. 
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From the Monotone Convergence Theorem, we deduce that there is @€ R such that lim, ,.. da, = @. 
Since the subsequence {a;,+;}7_, also converges to /, taking limits on both sides of the equation 
in (2.7), we obtain 
ea 
ae | 


Therefore, 32 = £+5 and, hence, = 5/2. 


t 


« Example 2.3.3 —The number e. Consider the sequence {a,} given by 


1 n 
a= (142) ,neN. 
n 


By the binomial theorem, 


ele 


n(n—1) 1  n(n—1)(n—2) 1 n(n—1)---(n—(n—1)) 1 
=e eee, eee 


Wael) ek (i-2) (mae (2) (3-8) 


The corresponding expression for a, has one more term and each factor (1 — k) is replaced by the 


an 


larger factor (1 — 4). It is then clear that a, < ay)+1 for alln € N. Thus, the sequence is increasing. 
Moreover, 


1. 1 
an <1 are rot 
1 1 1 
2 PRP 
we TO 33 (n—1)-n 
n—1 
1 1 1 
=2 =3 ox 
r( ci) n 


Hence the sequence is bounded above. 
By the Monotone Convergence Theorem, lim,,..d, exists and is denoted by e. In fact, e is an 
irrational number and e © 2.71828. 


The following fundamental result is an application of the Monotone Convergence Theorem. 


Theorem 2.3.3 — Nested Intervals Theorem. Let {/,}*°, be a sequence of nonempty closed 
bounded intervals satisfying J,41 C J, for all n € N. Then the following hold: 


(a) Mna=1tn #9. 
(b) If, in addition, the lengths of the intervals J, converge to zero, then (),,_; J, consists of a single 
point. 


Proof: Let {J,} be as in the statement with I, = [an, bn]. In particular, a, < by for all n € N. Given 


that I,41 C In, we have ay < ay41 and by+1 < by for all n € N. This shows that {a,} is an increasing 
sequence bounded above by b; and {b,} is a decreasing sequence bounded below by a. By the 
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Monotone Convergence Theorem (Theorem 2.3.1), there exist a,b € R such that lim,-,..d, =a 
and limy_,.0b, = b. Since a, < by, for all n, by Theorem 2.1.5, we get a < b. Now, we also have 
ay <aand b < b, for all n € N (since {a,} is increasing and {b,} is decreasing). This shows that if 
a<x<b, then x € I, for alln € N. Thus, [a,b] C | In. It follows that (\7_) J, 4 0. This proves 
part (a). 

Now note also that (\7"_, J, C [a,b]. Indeed, if x € (\f_, dn, then x € J, for all n. Therefore, 
Qn <x < by for all n. Using Theorem 2.1.5, we conclude a < x < b. Thus, x € [a,b]. This proves the 
desired inclusion and, hence, (\j7_; Jn = [a, 5]. 

We now prove part (b). Suppose the lengths of the intervals [, converge to zero. This means 
bn — an 2 Oasn— co. Then b = limy co Dy = limy.0[(Dp — An) + an] = a. It follows that 7) J, = 
{a} as desired. 


When a monotone sequence is not bounded, it does not converge. However, the behavior follows 
a clear pattern. To make this precise we provide the following definition. 


Definition 2.3.2 A sequence {a,} is said to diverge to ~ if for every M € R, there exists N € N such 
that 


dn > M for alln > WN. 


In this case, we write limy,.0d, =. Similarly, we say that {a,} diverges to —oo and write 
lim, 0d, = —o if for every M € R, there exists N € N such that 


a, <M foralln>N. 


Remark 2.3.4 We should not confuse a sequence that diverges to (that is, one that satisfies the 
previous definition), with a divergent sequence (that is, one that does not converge). 


a Example 2.3.4 Consider the sequence a, = sey We will show, using Definition 2.3.2, that 
limy+0o Ayn = °°. 
Let M € R. Note that 
nti nn 1 n 
Sn 5 
Choose N > 5M. Then, if n > N, we have 


n_wN 
o> eM. 
eae ae 
Th following result completes the description of the behavior of monotone sequences. 
Theorem 2.3.5 If a sequence {a,,} is increasing and not bounded above, then 
lim a, = ©. 
n—-co 


Similarly, if {a,} is decreasing and not bounded below, then 


lim ay, = —°°. 
n—-eco 


Proof: Fix any real number M. Since {a,} is not bounded above, there exists N € N such that 
ay > M. Then 


a, = ay > M foralln>N 


because {a,} is increasing. Therefore, limy—,..d, = 0. The proof for the second case is similar. 


45 


Theorem 2.3.6 Let {a,}, {b,}, and {c,} be sequences of real numbers and let k be a constant. 
Suppose 


lim a, = 9, lim b, = 0, and lim c, = —° 
n—-eco n—-eoo n—-co 


Then 


(a) limp —+0(An ae bn) 100, 
(b) lint, -9:( G8) =i09; 
(c) limy—+00(@n€n) = 


(d) limp kay = 0 if k > 0, and limy-—+oo kan = — if k < 0; 


(e) lim,5.— = 0. (Here we assume a, # 0 for all 7.) 
an 


Proof: We provide proofs for (a) and (e) and leave the others as exercises. 
(a) Fix any M ER. Since lim,_,..d, = 0%, there exists N; € N such that 


M 
dn > z for alln > Nj. 
Similarly, there exists N2 € N such that 
M 
b, > > for alln > Nj. 


Let N = max{N,N2}. Then it is clear that 
dn +b, >M for alln > N. 


This implies (a). 
1 
(e) For any € > 0, let M = e Since limy_5..dy, = 0, there exists N € N such that 


1 
an > - for alln > N. 
This implies that for n > N, 


—-0O)/=— <e. 
an an 


1 | 1 


Thus, (ec) holds. 


The proof of the comparison theorem below follows directly from Definition 2.3.2 (see also 
Theorem 2.1.5). 


Theorem 2.3.7 Suppose a, < b, for alln € N. 


(a) If lim,-5.d, = ©, then lim,_,.. by, = °°. 


(b) If lim, 5. by = —o, then limy 5. dy = —%. 
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Exercises 
2.3.1 » Leta; = «f 2. Define 


Ant) = Va, +2 forn > 1. 


(a) Prove that a, < 2 for alln € N. 
(b) Prove that {a,,} is an increasing sequence. 


(c) Prove that lim, 0d, = 2. 


2.3.2 > Prove that each of the following sequences is convergent and find its limit. 


forn> 1. 


(a) a4y =landayy; = 

(b) a; = V6 and ayy, = Va, +6 for n> 1. 
1 

(C) Qn41 = (201+ 


1 b 
(d) Qn41 == (a+ ae b> 0. 


2.3.3 > Prove that each of the following sequences is convergent and find its limit. 


(a) a ae 


(b) 1/2; 


mi 7 
2 
—— 


2.3.4 Prove that the following sequence is convergent: 


1 1 L 
=i apt ne 


2.3.5 [> Let a and b be two positive real numbers with a < b. Define a; = a, bj = b, and 


an + Pn forn> 1. 


Anti = V anby and bry = 


Show that {a,} and {b,} are convergent to the same limit. 
2.3.6 Prove the following using Definition 2.3.2. 


2n? 1 
(a) lim ange = 
noo = — 2 
3n2 


1— 
noo nt? 


2.3.7 Prove parts (b), (c), and (d) of Theorem 2.3.6. 


2.3.8 Prove Theorem 2.3.7. 
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2.4 THE BOLZANO-WEIERSTRASS THEOREM 


The Bolzano-Weierstrass Theorem is at the foundation of many results in analysis. It is, in fact, 
equivalent to the completeness axiom of the real numbers. 


Theorem 2.4.1 — Bolzano-Weierstrass. Every bounded sequence {a,} of real numbers has a 
convergent subsequence. 


Proof: Suppose {a,} is a bounded sequence. Define A = {a, : n € N} (the set of values of the 
sequence {a,}). If A is finite, then at least one of the elements of A, say x, must be equal to a, for 
infinitely many choices of n. More precisely, By = {n € N : a, = x} is infinite. We can then define 
a convergent subsequence as follows. Pick n; such that a,, = x. Now, since B, is infinite, we can 
choose nz > n; such that a,, = x. Continuing in this way, we can define a subsequence {dp, } which 
is constant, equal to x and, thus, converges to x. 

Suppose now that A is infinite. First observe there exist c,d € R such that c < a, < d for all 
né€N, that is, A C [c,d]. 

We define a sequence of nonempty nested closed bounded intervals as follows. Set J; = [c,d]. 
Next consider the two subintervals [c, ct) and [4 ,d]. Since A is infinite, at least one of AN [c, 4] 


or AN [44d] is infinite. Let hh = |c, ofa if AN [c, eta) is infinite and = [44d] otherwise: 
Continuing in this way, we construct a nested sequence of nonempty closed bounded intervals {J, } 
such that [, NA is infinite and the length of J, tends to 0 as n > -~, 

We now construct the desired subsequence of {a,} as follows. Let nj = 1. Choose nz > 1, such 
that ay, € l. This is possible since ) A is infinite. Next choose n3 > n2 such that ay, € 4. In this 
way, we obtain a subsequence {a,, } such that a, € i, for all k € N. 

Set J, = [Cn, dn]. Then limy-,.0(dy — Cn) = 0. We also know from the proof of the Monotone 
Convergence Theorem (Theorem 2.3.1), that {cy} converges. Say @ = limp. Cn. Thus, limy—s.odn = 
lim —00[(dn — Cn) + Cn] = £ as well. Since cy < dn, < dg for all k € N, it follows from Theorem 2.1.5 
that limy_,..4n, = ¢. This completes the proof. 


Definition 2.4.1 (Cauchy sequence). A sequence {a,} of real numbers is called a Cauchy sequence 
if for any € > 0, there exists a positive integer N such that for any m,n > N, one has 


|dm — Gn| < €. 


Theorem 2.4.2 A convergent sequence is a Cauchy sequence. 


Proof: Let {a,,} be a convergent sequence and let 
lim a, = a. 
n—300 

Then for any € > 0, there exists a positive integer NV such that 
|dn —a| < €/2 foralln>N. 


For any m,n > N, one has 


lam — @n| < |am — al +|a,—al < €/2+€/2=€. 


Thus, {a,,} is a Cauchy sequence. 
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Theorem 2.4.3 A Cauchy sequence is bounded. 


Proof: Let {a,} be a Cauchy sequence. Then for € = 1, there exists a positive integer N such that 
lam —@n| <1 for allm,n>N. 

In particular, 
|dn — an| < 1 for alln > N. 


Let M = max{|aj|,...,|ay—i|,1 + |ay|}. Then, for n = 1,...,N—1, we clearly have |a,| << M. 
Moreover, for n > N, 


|@n| = |@n — ay + ay| < |an — ay| +lay| < 1+ |ay| <M. 


Therefore, |a,| << M for all n € N and, thus, {a,,} is bounded. 


Lemma 2.4.4 A Cauchy sequence that has a convergent subsequence is convergent. 


Proof: Let {a,} be a Cauchy sequence that has a convergent subsequence. For any € > 0, there 
exists a positive integer N such that 


lam — an| < €/2 for all m,n > N. 


Let {dp } be a subsequence of {a,,} that converges to some point a. For the above €, there exists a 
positive number K such that 


|dn, —a| < €/2 forallk > K. 

Thus, we can find a positive integer ng > N such that 
|an, —a| < €/2. 

Then for any n > N, we have 


|an — al < |an — An,|+|an, —a| < €. 


Therefore, {a,,} converges to a. 


Theorem 2.4.5 Any Cauchy sequence of real numbers is convergent. 


Proof: Let {a,} be a Cauchy sequence. Then it is bounded by Theorem 2.4.3. By the Bolzano- 
Weierstrass theorem, {a,} has a convergent subsequence. Therefore, it is convergent by Lemma 
2.4.4, 


Remark 2.4.6 It follows from Definition 2.4.1 that {a,} is a Cauchy sequence if and only if for 
every € > 0, there exists N € N such that 


|Qn+p — 4n| < € for alln > N and forall p EN. 
Definition 2.4.2 A sequence {a,} is called contractive if there exists k € [0, 1) such that 


\an42 —Gn41| < k|an+1 —ap| for alln EN. 
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Theorem 2.4.7 Every contractive sequence is convergent. 


Proof: By induction, one has 
ldnt1 —Gn| < kay —a,|forallneN. 


Thus, 


l@nt-p — an| < |Qn41 an| |an42 an+1| ris | Gap Oni pot 
< (ROVE RE ERP) lay — ay | 
<1 4k4 4---+1)lay —a| 


for all n,p € N. Since k”~! — 0 as n > © (independently of p), this implies {a,} is a Cauchy 
sequence and, hence, it is convergent. 


a Example 2.4.1 The condition k < 1 in the previous theorem is crucial. Consider the following 


example. Let a, = Inn for alln € N. Since 1 < tae < “+! for all n € N and the natural logarithm is 


n 
an increasing function, we have 


(rr) |= aa) 


1 
<In ( ) (indie pa, 


|an42 — An41| = |In(n +2) —In(n+1)| = 


Therefore, the inequality in Definition 2.4.2 is satisfied with k = 1, yet the sequence {Inn} does 
not converge. 


Exercises 
2.4.1 » Determine which of the following are Cauchy sequences. 
(a) a, = (-1)’. 
(b) ad, = (—1)"/n. 
(c) ay =n/(n+1). 
(d) an = (cosn)/n. 


2.4.2 Prove that the sequence 


__ ncos(3n* + 2n+ 1) 
_ n+1 


has a convergent subsequence. 


2.5 
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2.4.3 Let f: [0,0c) + R be such that f(x) > 0 for all x. Define 


f(n) 
f(ay+h 


Prove that the sequence a, has a convergent subsequence. 


an = 


2.4.4 Define 


+ n 
an = —5,  forn EN. 
Prove that the sequence ay is contractive. 
2.4.5 Let r € R be such that |r| < 1. Define a, =r" for n € N. Prove that the sequence {a,} is 
contractive. 


co 


2.4.6 Prove that the sequence { -} is not contractive. 
n 


n=1 


LIMIT SUPERIOR AND LIMIT INFERIOR 


We begin this section with a proposition which follows from Theorem 2.3.1. All sequences in 
this section are assumed to be of real numbers. 


Proposition 2.5.1 Let {a,} be a bounded sequence. Define 

Sn = sup{a,: k>n} (2.8) 
and 

t) =inf{a,: k>n}. (2.9) 


Then {s,,} and {t,} are convergent. 


Proof: If n < m, then {a,: k > m} Cc {ax : k >n}. Therefore, it follows from Theorem 1.5.3 
that s, > s» and, so, the sequence {s,} is decreasing. Since {a,} is bounded, then so is {s,}. In 
particular, {s,,} is bounded below. Similarly, {t,} is increasing and bounded above. Therefore, both 
sequences are convergent by Theorem 2.3.1. 


Definition 2.5.1 Let {a,} be a sequence. Then the limit superior of {a,}, denoted by limsup,,_,.. dn, 
is defined by 


limsupa, = lim sup{a, : k > n}. 
n—-yoo n—-ree 


Note that limsup,,_,., @n = limp. 5, where s,, is defined in (2.8). 
Similarly, the limit inferior of {a,}, denoted by liminf,_,..d,, is defined by 


liminfa, = lim inf{a, : k >n}. 
n—-oo n—-co 


Note that liminf,,.. d, = limy_,..t,, where t, is defined in (2.9). 
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Theorem 2.5.2 If {a,,} is not bounded above, then 
lim s, = ©, 
n—oo 


where {s,} is defined in (2.8). 
Similarly, if {a,} is not bounded below, then 


lim t, = —°, 
n—}oo 


where {t,,} is defined in (2.9). 


Proof: Suppose {a,,} is not bounded above. Then for any k € N, the set {a; : i > k} is also not 
bounded above. Thus, s; = sup{a; : i > k} = for all k. Therefore, lim;_,.. 5, = ce. The proof for 
the second case is similar. 


Remark 2.5.3 By Theorem 2.5.2, we see that if {a,,} is not bounded above, then 


lim supa, = . 
n-co 


Similarly, if {a, } is not bounded below, then 


liminfa, = —°°. 
n—-}oo 


Theorem 2.5.4 Let {a,} be a sequence and ¢ € R. The following are equivalent: 


(a) limsup,,,..@n = &. 
(b) For any € > 0, there exists N € N such that 


an < €+€ for alln >N, 
and there exists a subsequence of {ap } of {a,} such that 
jim Gy. 
Proof: Suppose limsup,,_,..d, = &. Then lim,-,..5, = €, where s, is defined as in (2.8). For any 
€ > 0, there exists N € N such that 
l—-é€<s,<+€ foralln>N. 
This implies sy = sup{a,:n >N} < + €. Thus, 
a, <£+€ foralln>N. 
Moreover, for € = 1, there exists N; € N such that 
£—1<sy, =sup{a,:n>Ni}<2£+1. 
Thus, there exists ny € N such that 


£-1 <a, <£4+1. 
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1 
For € = > there exists Ny € N and N2 > n, such that 


1 1 
&— > <5, = Sup{an in 2 No} < f+ 5. 


Thus, there exists nz > n, such that 


1 1 
b— 5 <am <ét+5. 


In this way, we can construct a strictly increasing sequence {n,} of positive integers such that 


1 1 
aan < Gn, <E+ 5. 


Therefore, limj—y.. An, = &. 
We now prove the converse. Given any € > 0, there exists N € N such that 


a, <€+e€ and l—€ <a, <f+€ 

for alln > N and k > N. Let any m > N, we have 
Sm = sup{a,:k >m} <l+e. 

By Lemma 2.1.8, 2, => m, so we also have 


Sm = sup{ag:k > m} > a,,, > £—€. 


Therefore, limsy—+.0 5 = limsup,,,_,.6n = &. 


The following result is proved in a similar way. 
Theorem 2.5.5 Let {a,} be a sequence and ¢ € R. The following are equivalent: 


(a) liminf, 5..dy, = £. 
(b) For any € > 0, there exists N € N such that 


adn > €—€ foralln >N, 
and there exists a subsequence of {an, } of {a,} such that 
li =. 
as as 
The following corollary follows directly from Theorems 2.5.4 and 2.5.5. 
Corollary 2.5.6 Let {a,} be a sequence. Then 


lim a, = @ if and only if limsupa, = liminfa, = ¢. 
n—yoo Pay n—oo 


Corollary 2.5.7 Let {a,} be a sequence. 
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(a) Suppose limsup,_,..d@n = £ and {dap, } is a subsequence of {a,,} with 
lina, =f, 
k-yo0 
Then @ < &. 
(b) Suppose liminf,,..d, = £ and {dy, } is a subsequence of {a,,} with 
lim ay, = ¢. 
kyo 
Then @ > &. 


Proof: We prove only (a) because the proof of (b) is similar. By Theorem 2.5.4 and the definition 
of limits, for any € > 0, there exists N € N such that 


dn <€+€ and l’-—E<ay, <U +e 
for alln > N and k > N. Since ny > N, this implies 


Cl -€ <dy <fH+E. 


Thus, ¢’ < €+2e and, hence, ¢’ < @ because € is arbitrary. 


Remark 2.5.8 Let {a,} be a bounded sequence. Define 
A= {x €R: there exists a subsequence {a,,} with lima, = x}. 


Each element of the set A called a subsequential limit of the sequence {a,,}. It follows from Theorem 
2.5.4, Theorem 2.5.5, and Corollary 2.5.7 that A # 0 and 


limsupa, = maxA and liminfa, = minA. 
n-yoo a oa 


Theorem 2.5.9 Suppose {a,,} is a sequence such that a, > 0 for every n € N and 
lim sup “2+! =< 1, 
noo = Ay, 
Then lim,... da, = 0. 
Proof: Choose € > 0 such that 4+ € < 1. Then there exists N € N such that 


Gn+l — 94 ¢ foralln > N. 


n 


Let q=@+¢. Then 0 <q < 1. By induction, 


0<a,< q’ Nan foralln > N. 


Since lim,_5.. ge ay = 0, one has lim,_5.. dy, = 0. 


By a similar method, we obtain the theorem below. 
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Theorem 2.5.10 Suppose {a,} is a sequence such that a, > 0 for every n € N and 


liminf “"+! = ¢> 1. 
n—-co an 
Then lim). dy = °°. 
= Example 2.5.1 Given a real number @, define 


n 


a 
a, =—_, nEN. 
Nn. 


When @ = 0, it is obvious that lim,,..d, = 0. Suppose a > 0. Then 


a 
=0<1. 
1 < 


noo = Ay, ne 


Thus, lim,_;.d, = 0. In the general case, we can also show that lim,_,.a, = 0 by considering 
lim, +0. |@,| and using Exercise 2.1.3. 


Exercises 


All sequences in this set of exercises are assumed to be in R. 


2.5.1 Find limsup,_,..@, and liminf,_,..a, for each sequence. 


(a) dn = (-1)". 

(b) a, = sin (=). 
1 —] n 

(Cc) Qn= mee 


(d) a, =nsin (>). 


2.5.2 For a sequence {a,,}, prove that: 
(a) liminf,,.0d, = ° if and only if lim,_,.. dy, = ©. 
(b) limsup,,_,.. dn = —° if and only if lim,_,..@, = —°. 
2.5.3 Let {a,} and {b,} be bounded sequences. Prove that: 
(a) SUPk>n (an + bn) S SUPk>n Gk + SUPkK>n Dx. 
(b) infk>n (Gn + bn) = infk>n ak + infk>n Dx. 
2.5.4 » Let {a,} and {b,} be bounded sequences. 

(a) Prove that limsup,,_,..(@n + bn) < limsup,,_,..@n + limsup,,_,..Dn- 

(b) Prove that liminfp—..0(dn + bn) > liminfy 5.0. dn + liminfy soo Dn. 

(c) Find two counterexamples to show that the equalities may not hold in part (a) and part (b). 
Is the conclusion still true in each of parts (a) and (b) if the sequences involved are not necessarily 
bounded? 

2.5.5 Let {a,} be a convergent sequence and let {b,,} be an arbitrary sequence. Prove that 


(a) limsup,,_,.o(@n +n) = limsup,,,..@n + limsup,,_,.. Dn = limy 00 dy + limsup,,_,..Dp- 


(b) liminfy..0(dn + bn) = lim infps0o dy + liminfy0o bn = liMy—yoo An + Liminfy 500 bn. 
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2.6 OPEN SETS, CLOSED SETS, COMPACT SETS, AND LIMIT POINTS 
The open ball in R with center a € R and radius 6 > 0 is the set 


B(a;6) = (a—6,a+64). 


Definition 2.6.1 A subset A of R is said to be open if for each a € A, there exists 6 > 0 such that 


B(a;6) CA. 
« Example 2.6.1 (1) Any open interval A = (c,d) is open. Indeed, for each a € A, one has c <a<d. 
Let 
6 = min{a—c,d-—a}. 
Then 


B(a;6) = (a—6,a+4) CA. 
Therefore, A is open. 


(2) The sets A = (—c°,c) and B = (c, °°) are open, but the set C = [c, °°) is not open. The reader can 
easily verify that A and B are open. Let us show that C is not open. Assume by contradiction that C 
is open. Then, for the element c € C, there exists 6 > 0 such that 


B(c;6) = (c—6,c+ 6) CC. 
However, this is a contradiction because c — 6/2 € B(c;5), but c— 6/2 ¢C. 
Theorem 2.6.1 The following hold: 


(a) The subsets @ and R are open. 
(b) The union of any collection of open subsets of R is open. 


(c) The intersection of a finite number of open subsets of R is open. 


Proof: The proof of (a) is straightforward. 
(b) Suppose {Gg : & € J} is an arbitrary collection of open subsets of R. That means Gg, is open 
for every a € J. Let us show that the set 


G=|JGe 


ael 


is open. Take any a € G. Then there exists Q%& € 7 such that 
ace Ga. 
Since Gq, is open, there exists 6 > 0 such that 
B(a;8) C Ga. 


This implies 
B(a;6) CG 


because Ga, C G. Thus, G is open. 
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(c) Suppose G;,i = 1,...,, are open subsets of IR. Let us show that the set 


is also open. Take any a € G. Then a € G; fori = 1,...,n. Since each G; is open, there exists 6; > 0 
such that 
B(a; 6;) C G;. 


Let 6 = min{6;:i=1,...,n}. Then 6 > 0 and 


B(a;6) CG. 


Thus, G is open. 


Definition 2.6.2 A subset S of R is called closed if its complement, S° = R\S, is open. 


« Example 2.6.2 The sets [a,b], (—°°,a], and [a,co) are closed. Indeed, (—-,a]° = (a,o°) and 
[a, ¢)° = (—c0,a) which are open by Example 2.6.1. Since [a,b]° = (—,a) U(b,), [a,b]° is open 
by Theorem 2.6.!. Also, single element sets are closed since, say, {b}° = (—°,b) U (b, 2). 


Theorem 2.6.2 The following hold: 


(a) The sets 0 and R are closed. 
(b) The intersection of any collection of closed subsets of R is closed. 


(c) The union of a finite number of closed subsets of R is closed. 


Proof: The proofs for these are simple using the De Morgan’s law. Let us prove, for instance, (b). 
Let {Sq : a@ € I} be a collection of closed sets. We will prove that the set 


S=()Se 


ael 


is also closed. We have 


S= (ns) - BE 


ael ael 


Thus, S° is open because it is a union of opens sets in R (Theorem 2.6.1(b)). Therefore, S is closed. 


a Example 2.6.3 It follows from part (c) and Example 2.6.2 that any finite set is closed. 


Theorem 2.6.3 A subset A of R is closed if and only if for any sequence {a,} in A that converges 
to a point a € R, it follows that a € A. 


Proof: Suppose A is a closed subset of R and {a,} is a sequence in A that converges to a. Suppose by 
contradiction that a ¢ A. Since A is closed, there exists € > 0 such that B(a;€) = (a—€,a+€) CAS. 
Since {a,} converges to a, there exists N € N such that 


a—E<ayn<a+€. 


This implies ay € A‘, a contradiction. 
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Let us now prove the converse. Suppose by contradiction that A is not closed. Then A‘ is not 
open. Since A‘ is not open, there exists a € A‘ such that for any € > 0, one has B(a;e) NA # @. In 
particular, for such an a and for each n €N, there exists a, € B(a; ) OA. It is clear that the sequence 
{a} is in A and it is convergent to a (because |a, — a| < i for alln € N). This is a contradiction 
since a ¢ A. Therefore, A is closed. 


Theorem 2.6.4 If A is a nonempty subset of R that is closed and bounded above, then maxA exists. 
Similarly, if A is a nonempty subset of R that is closed and bounded below, then minA exists 


Proof: Let A be a nonempty closed set that is bounded above. Then supA exists. Let m = supA. To 
complete the proof, we will show that m € A. Assume by contradiction that m ¢ A. Then m€ A‘, 
which is an open set. So there exists 6 > 0 such that 


(m—6,m+6) CAS. 
This means there exists no a € A with 
m—6<a<m. 


This contradicts the fact that m is the least upper bound of A (see Proposition 1.5.1). Therefore, 
maxA exists. 


Definition 2.6.3 A subset A of R is called compact if for every sequence {a,} in A, there exists a 
subsequence {a,, } that converges to a point a € A.! 


= Example 2.6.4 Let a,b € R, a< b. We show that the set A = [a,b] is compact. Let {a,} be a 
sequence in A. Since a < a, < b for all n, then the sequence is bounded. By the Bolzano-Weierstrass 
theorem (Theorem 2.4.1), we can obtain a convergent subsequence {dp,}. Say, limy_5..dn, = s. We 
now must show that s € A. Since a < dy, < b for all k, it follows from Theorem 2.1.5, thata<s <b 
and, hence, s € A as desired. We conclude that A is compact. 


Theorem 2.6.5 A subset A of R is compact if and only if it is closed and bounded. 


Proof: Suppose A is a compact subset of R. Let us first show that A is bounded. Suppose, by 
contradiction, that A is not bounded. Then for every n € N, there exists a, € A such that 


|dn| > n. 
Since A is compact, there exists a subsequence {dn,} that converges to some a € A. Then 
|an,| =n >k for all k. 


Therefore, limy_,..|@n,| = °°. This is a contradiction because {|a,,|} converges to |a|. Thus A is 
bounded. 

Let us now show that A is closed. Let {a,} be a sequence in A that converges to a point a € R. 
By the definition of compactness, {a,} has a subsequence {a,,} that converges to b € A. Then 
a=b€A and, hence, A is closed by Theorem 2.6.3. 

For the converse, suppose A is closed and bounded and let {a,} be a sequence in A. Since A 
is bounded, the sequence is bounded and, by the Bolzano-Weierstrass theorem (Theorem 2.4.1), it 


'This definition of compactness is more commonly referred to as sequential compactness. 
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has a convergent subsequence, {ay,}. Say, limgs. Gn, = a. It now follows from Theorem 2.6.3 that 
a €A. This shows that A is compact as desired. 


Definition 2.6.4 (cluster/limit/accumulation point). Let A be a subset of R. A point a € R (not 
necessarily in A) is called a limit point of A if for any 6 > 0, the open ball B(a; 6) contains an infinite 
number of points of A. 

A point a € A which is not an accumulation point of A is called an isolated point of A. 


uw Example 2.6.5 (1) Let A = (0,1). Then a = 0 is a limit point of A and b = 1 is also a limit 
point of A. In fact, any point of the interval [0,1] is a limit point of A. The set [0,1) has no 
isolated points. 


(2) Let A = Z. Then A does not have any limit points. Every element of Z is an isolated point of 
Z. 

(3) LetA = {1/n:n€ N}. Then a = 0 is the only limit point of A. All elements of A are isolated 
points. 


a Example 2.6.6 If G is an open subset of R then every point of G is a limit point of G. In fact, 
more is true. If G is open and a € G, then a is a limit point of G\ {a}. Indeed, let 6 > 0 be such that 
B(a;6) C G. Then (G\ {a}) NB(a; 6) = (a—6,a)U(a,a+ 54) and, thus B(a; 6) contains an infinite 
number of points of G \ {a}. 


The following theorem is a variation of the Bolzano-Weierstrass theorem. 


Theorem 2.6.6 Any infinite bounded subset of R has at least one limit point. 


Proof: Let A be an infinite subset of R and let {a,,} be a sequence of A such that 
Am # An formA#An 


(see Theorem |.2.7). Since {a,} is bounded, by the Bolzano-Weierstrass theorem (Theorem 2.4.1), 
it has a convergent subsequence {dy, }. Set b = limg_4.0dn,. Given 6 > 0, there exists K € N such 
that a, € B(b; 6) for k > K. Since the set {a,, :k > K} is infinite, it follows that b is a limit point of 
A. 


The following definitions and results provide the framework for discussing convergence within 
subsets of R. 


Definition 2.6.5 Let D be a subset of R. We say that a subset V of D is open in D if for every a € V, 
there exists 6 > 0 such that 


B(a,5)ADCY. 


Theorem 2.6.7 Let D be a subset of R. A subset V of D is open in D if and only if there exists an 
open subset G of R such that 


V=DnNG. 

Proof: Suppose V is open in D. By definition, for every a € V, there exists 6, > 0 such that 
B(a36g) ND CV. 

Define 
G = UaevB(a; 6a) 
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Then G is a union of open subsets of R, so G is open. Moreover, 
V C GND = Ugev [B(a; 6g) MD] C V. 


Therefore, V = GND. 
Let us now prove the converse. Suppose V = GMD, where G is an open set. For any a € V, we 
have a € G, so there exists 6 > 0 such that 


B(a;6) CG. 
It follows that 


B(a;6) NDC GND=V. 


The proof is now complete. 


» Example 2.6.7 Let D = (0,1) and V = [0,5). We can write V = DM (—1,+4). Since (—1, 5) is 
open in R, we conclude from Theorem 2.6.7 that V is open in D. Notice that V itself is not an open 
subset of R. 


The following theorem is now a direct consequence of Theorems 2.6.7 and 2.6.1. 
Theorem 2.6.8 Let D be a subset of R. The following hold: 


(a) The subsets @ and D are open in D. 
(b) The union of any collection of open sets in D is open in D. 


(c) The intersection of a finite number of open sets in D is open in D. 


Definition 2.6.6 Let D be a subset of IR. We say that a subset A of D is closed in D if D\ A is open 
in D. 


Theorem 2.6.9 Let D be a subset of R. A subset K of D is closed in D if and only if there exists a 
closed subset F of R such that 


K=DOF. 


Proof: Suppose K is a closed set in D. Then D\ K is open in D. By Theorem 2.6.7, there exists an 
open set G such that 


D\K=D0G. 
It follows that 
K=D\(D\K)=D\(DNG)=D\G=DnNG. 


Let F = G°. Then F is a closed subset of R and K = DNF. 
Conversely, suppose that there exists a closed subset F of R such that K = DOF. Then 


D\K =D\(DNF) =D\F =DnF*. 


Since F° is an open subset of R, applying Theorem 2.6.7 again, one has that D \ K is open in D. 
Therefore, K is closed in D by definition. 
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» Example 2.6.8 Let D = (0,1) and K = [4,1). We can write K = DN[},2]. Since [5,2] is closed 
in R, we conclude from Theorem 2.6.9 that K is closed in D. Notice that K itself is not a closed 


subset of R. 


Corollary 2.6.10 Let D be a subset of IR. A subset K of D is closed in D if and only if for every 
sequence {x;,} in K that converges to a point x € D it follows that x € K. 

Proof: Let D be a subset of R. Suppose K is closed in D. By Theorem 2.6.9, there exists a closed 
subset F of IR such that 


K=DOF. 


Let {x;,} be a sequence in K that converges to a point * € D. Since {x;} is also a sequence in F and 
F is aclosed subset of R, x € F. Thus, x € DO F=K. 

Let us prove the converse. Suppose by contradiction that K is not closed in D or D\ K is not 
open in D. Then there exists * € D\ K such that for every 6 > 0, one has 


B(x;5)ND EZ D\K. 
In particular, for every k € N, 
_ 1 
B( x7 )NDED\K. 
For each k € N, choose x; € B(¥;+) AD such that x, ¢ D\ K. Then {x;} is a sequence in K and, 


moreover, {x;,} converges to x € D. Then x € K. This is a contradiction. We conclude that K is 
closed in D. 


The following theorem is a direct consequence of Theorems 2.6.9 and 2.6.2. 
Theorem 2.6.11 Let D be a subset of R. The following hold: 


(a) The subsets @ and D are closed in D. 
(b) The intersection of any collection of closed sets in D is closed in D. 


(c) The union of a finite number of closed sets in D is closed in D. 


» Example 2.6.9 Consider the set D = [0, 1) and the subset A = [5, 1). Clearly, A is bounded. We 
showed in Example 2.6.8 that A is closed in D. However, A is not compact. We show this by finding 
a sequence {a,} in A for which no subsequence converges to a point in A. 

Indeed, consider the sequence a, = 1 — + for n € N. Then a, € A for all n. Moreover, {a,} 
converges to | and, hence, every subsequence also converges to 1. Since | ¢ A, it follows that A is 
not compact. 


Exercises 


2.6.1 Prove that a subset A of R is open if and only if for any x € A, there exists n € N such that 
(x—1/n,x+1/n) CA. 


2.6.2 Prove that the interval [0, 1) is neither open nor closed. 


2.6.3 > Prove that if A and B are compact subsets of R, then AU B is a compact set. 
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2.6.4 Prove that the intersection of any collection of compact subsets of IR is compact. 


2.6.5 Find all limit points and all isolated points of each of the following sets: 


(a) A= (0,1). 
(b) B= 0,1). 
(c) C=Q. 


(d) D={m+1/n : m,ne N}. 


2.6.6 Let D = [0,c¢). Classify each subset of D below as open in D, closed in D, neither or both. 
Justify your answers. 


(a) A= (0,1). 

(b) B=N. 

(c) C=QND. 
(d) D=(-1,]]. 


(e) B= (-2,0). 
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3. LIMITS AND CONTINUITY 


In this chapter, we extend our analysis of limit processes to functions and give the precise 
definition of continuous function. We derive rigorously two fundamental theorems about continuous 
functions: the extreme value theorem and the intermediate value theorem. 


LIMITS OF FUNCTIONS 
Definition 3.1.1 Let f: D— R and let x be a limit point of D. We say that f has a limit at x if there 
exists a real number £ such that for every € > 0, there exists 6 > 0 with 

f(x) -<e 
for all x € D for which 0 < |x —x| < 6. In this case, we write 

mw =t 
Remark 3.1.1 Note that the limit point x in the definition of limit may or may not be an element of 
the domain D. In any case, the inequality | f(x) — ¢| < € need only be satisfied by elements of D. 


a Example 3.1.1 Let f: R— R be given by f(x) =5x—7. We prove that lim,_,2 f(x) = 3. Let 
€ > 0. First note that | f(x) — 2| = |5x —7—3| = |5x— 10] =5|x—2|. This suggests the choice 
6 = e/5. Then, if |x—2| < 6 we have 


lfaj=2| =se=2| 56 Se. 


» Example 3.1.2 Let f: [0,1) > R be given by f(x) =x* +x. Let = 1 and / = 2. First note that 
| f(x) — | = |x? +x—2| = |x—1||x+2| and for x € [0,1), |x+2| < |x| +2 <3. Now, given € > 0, 
choose 6 = €/3. Then, if |x—1| < 6 and x € [0,1), we have 

E 


f= ta=2) == Ie 2) 30 = 33 


= €. 


This shows that lim,_,; f(x) = 2. 
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» Example 3.1.3 Let f: R — R be given by f(x) =x’. We show that lim, 2 f(x) =4. First 
note that | f(x) — 4| = |x? — 4| = |(x—2)(x+2)| = |x—2||x+ 2]. Since the domain is all of R the 
expression |x + 2| is not bounded and we cannot proceed as in Example 3.1.2. However, we are 
interested only in values of x close to 2 and, thus, we impose the condition 6 < 1. If |x—2| < 1, then 
—1<x-—2< 1 and, so, 1 <x <3. It follows, for such x, that |x| <3 and, hence |x| +2 <5. 

Now, given € > 0 we choose 6 = min{1, =}. Then, whenver |x — 2| < 6 we get 


|f (x) —4| = |x—2|x+2| < |x-—2|(\x] +2) < 65 <e. 


« Example 3.1.4 Let f: R— R be given by f(x) = 5 : 
x 
we look at the expression | f(x) — (—4)| and try to identify a factor |x —1| (because here ¥ = 1). 


w-(3) 


Proceeding as in the previous example, if |x— 1] < 1 we get —1 <x—1< | and, so, 0 <x < 2. Thus 
|x| <2 and |x+7| < |x| +2<9. 
Now, given € > 0, we choose 6 = min{1, Se}. It follows that if |x—1| < 6 we get 


1 
. We prove that lim,_,; f(x) = — . First 


|x —1||x+7]. 


6x—10+37+3| |x—1||x+7| _ 1 
+ = < 
x274+3 2 


x7 +3 2(x7+3) ~ 6 


3x—5 s|= 


1 | J |x+7| 


9 
fy] x Ee - <Pace. 


The following theorem will let us apply our earlier results on limits of sequences to obtain new 
results on limits of functions. 


Theorem 3.1.2 — Sequential Characterization of Limits. Let /: D— R and let x be a limit point 
of D. Then 


linn f(x) =2 (3.1) 
XX 

if and only if 
lim f(s,)=¢ (3.2) 
noo 


for every sequence {x,} in D such that x, 4 x for every n and {x,} converges to X. 


Proof: Suppose (3.1) holds. Let {x,} be a sequence in D with x, 4 x for every n and such that {x, } 
converges to x. Given any € > 0, there exists 6 > 0 such that | f(x) — ¢| < € whenever x € D and 
0 < |x—<x| < 6. Then there exists N € N with 0 < |x, —x| < 6 for alln > N. For such n, we have 


lf (Xn) =¢ <E. 


This implies (3.2). 
Conversely, suppose (3.1) is false. Then there exists & > 0 such that for every 6 > 0, there 
exists x € D with 0 < |x—x| < 6 and | f(x) — ¢| > &. Thus, for every n €N, there exists x, € D with 
1 
0 < |x, —x| < — and |f(x,) —¢| > €. By the squeeze theorem (Theorem 2.1.6), the sequence {x, } 
n 


converges to x. Moreover, x, 4 x for every n. This shows that (3.2) is false. It follows that (3.2) 
implies (3.1) and the proof is complete. 
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Corollary 3.1.3 Let f: D— R and let x be a limit point of D. If f has a limit at x, then this limit is 

unique. 

Proof: Suppose by contradiction that f has two different limits ¢; and /). Let {x,} be a sequence 

in D \ {x} that converges to *. By Theorem 3.1.2, the sequence { f(x,)} converges to two different 

limits @; and £. This is a contradiction to Theorem 2.1.3. 
The following corollary follows directly from Theorem 3.1.2. 


Corollary 3.1.4 Let f: D— R and let x be a limit point of D. Then f does not have a limit at x if 
and only if there exists a sequence {x,} in D such that x, 4 * for every n, {x,} converges to X, and 
{f (Xn) } does not converge. 


a Example 3.1.5 Consider the Dirichlet function f: R — R given by 


om ic if xe Q: 


0, if xeQ. 


Then lim,_,; f(x) does not exist for any * € R. Indeed, fix * € IR and choose two sequences {r,}, 
{s,} converging to ¥ such that r, € Q and s, ¢ Q for alln € N. Define a new sequence {x,} by 


rp, if n= 2k; 
Xn = 
se, if n=2k—-1. 


It is clear that {x,, } converges to x. Moreover, since { f(r,)} converges to | and {f(s,)} converges 
to 0, Theorem 2.1.9 implies that the sequence {f(x,)} does not converge. It follows from the 
sequential characterization of limits that lim,_,; f(x) does not exist. 


Theorem 3.1.5 Let f,g: D— R and let x be a limit point of D. Suppose that 
lim f(x) = 41, limg(x) = 42, 

and that there exists 6 > 0 such that 
f(x) < g(x) for all x € B(%;6)ND,x AX. 


Then £; < éo. 


Proof: Let {x,} be a sequence in B(x;6) 1D = (x— 6,*+6)/MD that converges to ¥ and x, A x for 
all n. By Theorem 3.1.2, 


lim f(x) = 4; and lim g(x,) = £2. 
n—0o no 


Since f(x,) < g(x,) for all n € N, applying Theorem 2.1.5, we obtain ¢; < £. 


Theorem 3.1.6 Let f,g: D— R and let x be a limit point of D. Suppose 
lim f(x) = oe lim g(x) = oe 
and £; < ¢. Then there exists 6 > 0 such that 


f(x) < g(x) for all x € B(%;6)ND,x AX. 
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Proof: Choose € > 0 such that 2; + € < & — € (equivalently, such that € < oh), Then there exists 
6 > 0 such that 


£,-€< f(x) <é;+e and ,-E€<g(x)<&+e 
for all x € B(x;6)D,x AX. Thus, 


f(x) <@+8& <-€ < g(x) for all x € B(#;6)ND,x FX. 


The proof is now complete. 


Theorem 3.1.7 Let f,g,4: D— R and let x be a limit point of D. Suppose there exists 6 > 0 
such that f(x) < g(x) < h(x) for all x € B(%;6)ND,x A x. If lim, f(x) = limy_,;h(x) = 4 then 
lim, g(x) = @. 


Proof: The proof is straightforward using Theorem 2.1.6 and Theorem 3.1.2. 


Remark 3.1.8 We will adopt the following convention. When we write lim,_,; f(x) without speci- 
fying the domain D of f we will assume that D is the largest subset of R such that if x € D, then 
f(x) results in a real number. For example, in 


: 1 
lim 
x32x+3 
we assume D = R\{—3} and in 


lim /x 


x1 


we assume D = [0,°°). 


Exercises 
3.1.1 Use the definition of limit to prove that 


(a) limy423x-7=-1. 

(b) lim,,3(x2 + 1) = 10. 

6) fit fe 
x+1 


(d) limy_.0 \/x = 0. 
(e) lim,_,2x° = 8. 


3.1.2 Prove that the following limits do not exist. 
a 
(a) lim, 0 —-. 
|x| 
(b) lim,_,9 cos(1/x). 
3.1.3 Let f: D— R and let x be a limit point of D. Prove that if lim,_,; f(x) = @, then 
lim |f(x)| =A. 


Give an example to show that the converse is not true in general. 


3.2 
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3.1.4 Let f: D— R and let x be a limit point of D. Suppose f(x) > 0 for all x € D. Prove that if 
lim,.5z f(x) = 2, then 


lim / f(x) = V2. 
XX 
3.1.5 Find lim,,9xsin(1/x). 
3.1.6 » Let f be the function given by 
Xx, if x € QN0, 1]; 
fla) = sarily 
1—x, if xeQn 0,1). 
Determine which of the following limits exist. For those that exist find their values. 


(a) limy_,1/2 f(x). 
(b) lim, 0 f(x). 
(c) lim,—51 f (x). 


LIMIT THEOREMS 


Here we state and prove various theorems that facilitate the computation of general limits. 


Definition 3.2.1 Let f,g: D— R and let c be a constant. The functions f+, fg, and cf are 
respectively defined as functions from D to R by 


(fof 


for x € D. 
Theorem 3.2.1 Let f,g: D— Rand let c € R. Suppose <x is a limit point of D and 
lim f(x) = 4, lim g(x) =m. 


Then 


(a) limy2(f+8)(x) =é+m, 


68 3,2 LIMIT THEOREMS 


Proof: Let us first prove (a). Let {x,} be a sequence in D that converges to ¥ and x, ~ x for every n. 
By Theorem 3.1.2, 


lim f(x,) =@ and lim g(x,) =m. 
n—-eoo n— oo 
It follows from Theorem 2.2.1 that 
lim (f Xn) + 8(in)) = €+m. 
n—co 


Applying Theorem 3.1.2 again, we get lim,.;(f + g)(x) = @-+m. The proofs of (b) and (c) are 
similar. 

Let us now show that if m # 0, then <x is a limit point of D. Since < is a limit point of D, there is 
a sequence {u,} in D converging to * such that u, 4 x for every k. Since m # 0, it follows from an 
easy application of Theorem 3.1.6 that there exists 6 > 0 with 


g(x) £0 whenever 0 < |x —x| < 6,x ED. 
This implies 
x € D whenever 0 < |x— | < 5,x € D. 


Then uz € D for all k sufficiently large, and hence x is a limit point of D. The rest of the proof of (d) 
can be completed easily following the proof of (a). 


vs 
Fe 
« Example 3.2.1 Consider f: R\ {—7} > R given by f(x) = ata. Then, combining all 
x 
parts of Theorem 3.2.1, we get 


limy,-2(x?++2x—3) lim, ,_2x* +lim,,_22x—lim,,_23 
lim_ f(x) = = 


x42 lim, y-2(x+7) lim,,_2x+lim,,_27 


(lim, sx)? +2limy,-2x—lim,,-23 _ (—2)?+2(-2)-3 3 


lim,_;—2 x + lim,_,_-27 —2+7 om 
a Example 3.2.2 We proceed in the same way to compute the following limit. 


1+(2x-1)? lim, 491+lim,,9(2x-1)? 1+1 2 
1m = = ——_—s 
x0 x2 +47 lim,_50 xe lim,_9 7 O+7 7 


=a Example 3.2.3 We now consider 
+ 6x+5 
im_ ————— 
x31 x+1 
Since the limit of the denominator is 0 we cannot apply directly part (d) of Theorem 3.2.1. Instead, 
we first simplify the expression keeping in mind that in the definition of limit we never need to 


evaluate the expression at the limit point itself. In this case, this means we may assume that x £ —1. 
For any such x we have 


XY +6x+5 — (x+1)(x+5) 


= =x-+5. 
x+1 x+1 * 
Therefore, 
2 
i a et 
x>-1 x+1 x>-1 
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Theorem 3.2.2 (Cauchy’s criterion) Let f: D— R and let x be a limit point of D. Then f has a 
limit at x if and only if for any € > 0, there exists 6 > 0 such that 


|f(r) — f(s)| < € whenever r,s € D and 0 < |r—x| < 6,0 < |s—z| <6. (3.3) 


Proof: Suppose lim,_,; f(x) = @. Given € > 0, there exists 6 > 0 such that 
| f(x) -e| < 5 whenever x € D and 0 < |x—x| < 6. 


Thus, for 7,s € D with 0 < |r—x| < 6 and 0 < |s—x| < 6, we have 


f(r) — F(s)| < |f(r) — 2] + |2—f(s)| <e. 


Let us prove the converse. Fix a sequence {u,} in D such with limy_,.o Up, = X and u, # X for every n. 
Given € > 0, there exists 6 > 0 such that 


| f(r) — f(s)| < € whenever r,s € D and 0 < |r—x| < 6,0 < |s—z| <6. 
Then there exists N € N satisfying 

0 < |un —x| < 6 for alln > N. 
This implies 

|f (un) — f(Um)| < € for all m,n > N. 
Thus, {f(un)} is a Cauchy sequence, and hence there exists @ € R such that 


lim f (un) = &. 


n—-yoo 


We now prove that f has limit @ at ¥ using Theorem 3.1.2. Let {x,} be a sequence in D such that 
limys00X, = ¥ and x, # X for every n. By the previous argument, there exists ¢’ € R such that 


lim f (X») = 0. 


noo 


Fix any € > 0 and let 6 > 0 satisfy (3.3). There exists K € N such that 
\uy —X| < 6 and |x, —x|<6 


for alln > K. Then | f (un) — f(xn)| < € for such n. Letting n > 0, we have |f— @’| < €. Thus, 0= 
since € is arbitrary. It now follows from Theorem 3.1.2 that lim,_,; f(x) = @. 
The rest of this section discussed some special limits and their properties. 


Definition 3.2.2 Let a < R and 6 > 0. Define 


B_(a;6) = (a—6,a) and B,(a;6) = (a,a+6). 


Given a subset A of R, we say that a is a left limit point of A if for any 6 > 0, B_(a; 6) contains 
an infinite number of elements of A. Similarly, a is called a right limit point of A if for any 6 > 0, 
B.,.(a; 6) contains an infinite number of elements of A. 
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It follows from the definition that a is a limit point of A if and only if it is a left limit point of A 
or it is a right limit point of A. 


Definition 3.2.3 (One-sided limits) Let f: D— R and let x be a left limit point of D. We write 


if for every € > 0, there exists 6 > 0 such that 
| f(x) — | < € for all x € B_(; 5). 


We say that @ is the left-hand limit of f at x. The right-hand limit of f at x can be defined in a similar 
way and is denoted lim, ,;+ f(x). 


« Example 3.2.4 Consider the function f: R\ {0} — R given by 


Let x = 0. Note first that 0 is a limit point of the set D = R\ {0} > R. Since, for x > 0, we have 
f(x) =x/x = 1, we have 


lim f(x) = lim 1=1. 


x>Xt x—0+ 


Similarly, for x < 0 we have f(x) = —x/x = —1. Therefore, 


lim f(x) = lim —1=-1. 


XT x07 
a Example 3.2.5 Consider the function f: R — R given by 
x+4, ifx<-l; 
x)= 3.4 
P(x) ei ifx>-—1. ac 
We have 


li = lim r—-1=0 
ee) Pies : 


and 


lim f(x)= lim x+4=3, 


x17 x17 


The following theorem follows directly from the definition of one-sided limits. 


Theorem 3.2.3 Let f: D— R and let x be both a left limit point of D and a right limit point of D. 
Then 


lim f(x) =¢ 


XX 


if and only if 


lim f(x) =@and lim f(x) =. 


x>xXt xX>X- 


7\ 


a Example 3.2.6 It follows from Example 3.2.4 that lim,_,9 bel does not exists, since the one-sided 
limits do not agree. 


Definition 3.2.4 (monotonicity) Let f: (a,b) > R. 


(1) We say that f is increasing on (a,b) if, for all x1,x2 € (a,b), x1 < x2 implies f(x) < f(x2). 
(2) We say that f is decreasing on (a,b) if, for all x1,x2 € (a,b), x1 < x2 implies f(x1) > f (x2). 


If f is increasing or decreasing on (a,b), we say that f is monotone on this interval. Strict mono- 
tonicity can be defined similarly using strict inequalities: f(x1) < f(x2) in (1) and f(x1) > f(x2) 
in (2). 


Theorem 3.2.4 Suppose f: (a,b) — R is increasing on (a,b) and x € (a,b). Then lim,_,;- f(x) 
and lim,_,;+ f(x) exist. Moreover, 


sup f(x) = lim f(x) < f(@) < lim f(x) = inf f(x). 


aA<xX<X ¥<x<b 


Proof: Since f(x) < f() for all x € (a,x), the set 


{f(x) :x € (a,)} 


is nonempty and bounded above. Thus, 


€= sup f(x) 


aA<X<*¥ 


is areal number. We will show that lim,_,;- f(x) = @. For any € > 0, by the definition of the least 
upper bound, there exists a < x; < x such that 


l-E€< f(x ). 
Let 6 = X—x, > 0. Using the increasing monotonicity, we get 


l-—e< f(x) <f(x) << +e for all x € (41,%) = B_(X;5). 


Therefore, lim,_,;- f(x) = ¢. The rest of the proof of the theorem is similar. 


Let 
Bo(%;6) = B_ (x; 6) UB+(%;6) = (¥-— 6,¥4 8) \ {%}. 


Definition 3.2.5 (infinite limits) Let f: D— R and let x be a limit point of D. We write 
lim f(x) = ee 

if for every M € R, there exists 6 > 0 such that 
f(x) > M for all x € Bo(%;6) ND. 

Similarly, we write 
lim f(s) == 


if for every M € R, there exists 6 > 0 such that 


f(x) <M for all x € Bo(%;6) ND. 
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Infinite limits of functions have similar properties to those of sequences from Chapter 2 (see 
Definition 2.3.2 and Theorem 2.3.6). 


a Example 3.2.7 We show that lim,_;; ave = co directly from Definition 3.2.5. 
1 


Let M © R. We want to find 6 > 0 that will guarantee Gory > M whenever 0 < |Ix—1| < 6. 


As in the case of finite limits, we work backwards from Gap > M to an inequality for |x — 1]. 
1 


To simplify calculations, note that |M| +1 > M. Next note that ——, > |M|+ 1, is equivalent to 


GIP 
mai > B=. 


Now, choose 6 such that 0 < 6 < rire Then, if 0 < |x—1| < 6 we have 


1 1 
> 


= =|M|+1>M 
ip eo 


1 
i 
|M|+1 
as desired. 
Definition 3.2.6 (limits at infinity) Let f: D— R, where D is not bounded above. We write 
lim f(x) = ¢ 
if for every € > 0, there exists c € R such that 
| f(x) —24| < € forall x >c,x € D. 
Let f: D— R, where D is not bounded below. We write 
lim fla) = 6 
if for every € > 0, there exists c € R such that 


| f(x) —24| < € for all x <c,x € D. 


We can also define 


lim f(x) = -teo and lim FO) = BECO 


in a similar way. 


a Example 3.2.8 We prove from the definition that 


3x7 +x so 


2x24+1 2 


lim 
X—}—00 


The approach is similar to that for sequences, with the difference that x need not be an integer. 
Let € > 0. We want to identify c so that 
3x7 +x 3 


2x2 +1 -3 a oe 


for allx <c. 
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Now, tee i = sis. Therefore, simplifying, 3.5 is equivalent to 
1 2(2x?+1) 
Jue ; 3.6 
€ |2x — 3| ey 


We first restrict x to be less than 0, so |2x—3| > 3. Then, since a < oe, 3.6 will be guaranteed 


if 1/€ < 4x? /3 or, equivalently \/3/(4e) < |x|. We set c < min{0,—,/3/(4e€)}. Then, if x <c, we 


have ,/3/(4€) < —x = |x|. Thus, 1/e < a and, hence, 


3x°+x 3] |2x-3| ae 
Qx2+1 2] 2(2x2+1) ~~ 


Exercises 
3.2.1 Find the following limits: 


3x2 —2x+5 
(a) lim,» ——___, 
x—3 
: x7 +4x4+3 
(b) tim, 3" 
x-—9 


3.2.2 Let f: D— R and let X is a limit point of D. Prove that if lim,_,; f(x) exists, then 


lim[f(x)]" = [lim f(x)]", for any ne N. 


XX XX 
3.2.3 Find the following limits: 


: x—1 
(a) tim, 4, Yo 
x-—1 
InN 


(b) lim,_,, = where m,n € N, 
xt — ] 


(c) lim,_51 eat where m,n € N, m,n > 2, 


(d) limy +1 ea 


x-1 


3.2.4 Find the following limits: 


(a) limyy.0(W2x3 + 3x2 — Vx? +1). 
(b) limy,_..(W/x3 + 3x? — Vx? + 1). 


3.2.5 » Let f: D— R and let x be a limit point of D. Suppose that 
If(x) — f)| < kx — y| for all x,y € D\ {x}, 
where k > 0 is a constant. Prove that lim,_,; f(x) exists. 


3.2.6 Determine the one-sided limits lim,,3+[x] and lim,_,3- [x], where |x] denotes the greatest 
integer that is less than or equal to x. 


3.3 
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3.2.7 Find each of the following limits if they exist: 


1 
(a) lim,_,1+ peal , 
x—-1 


(b) lim,_,o+ [x7 sin(1/x)|. 


(c) lim,41(x— []). 
3.2.8 Fora €R, let f be the function given by 
x if x>1; 
FQ) = a 1, if x<1. 
Find the value of a such that lim,_,; f(x) exists. 
3.2.9 Determine all values of < such that the limit lim,_,;(1 +x — [x]) exists. 
3.2.10 Let a,b € R and suppose f : (a,b) > R is increasing. Prove the following. 


(a) If f is bounded above, then lim,_,,- f(x) exists and is a real number. 
(b) If f is not bounded above, then lim,_,,,- f(x) =. 


State and prove analogous results in case f is bounded below and in case that the domain of f is one 
of (—2,b), (a,°), or (—00, 00). 


CONTINUITY 


Definition 3.3.1 Let D be a nonempty subset of R and let f: D— R be a function. The function f 
is said to be continuous at xo € D if for any real number € > 0, there exists 6 > 0 such that if x € D 
and |x —x9| < 6, then 


If(x) — fo) < €. 


If f is continuous at every point x € D, we say that f is continuous on D (or just continuous if no 
confusion occurs). 


f(xo) +e - 
1 i 
Pig )) pe ee ea 


f(x) —€ - 


wy—d VOX ay+d 


Figure 3.1: Definition of continuity. 
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« Example 3.3.1 Let f: R— R be given by f(x) = 3x+7. Let xo € R and let € > 0. Choose 
6 = €/3. Then if |x —xo| < 6, we have 
If (x) — F(%0)| = |3x+7— (3x0 +7)| = [30% — x0) = 3|x— 2x0] < 36 = €. 


This shows that f is continuous at xo. 


Remark 3.3.1 Note that the above definition of continuity does not mention limits. This allows 
to include in the definition, points x9 € D which are not limit points of D. If xo is an isolated 
point of D, then there is 6 > 0 such that B(x9;6) ND = {xo}. It follows that for x € B(x0;6) OD, 
| f(x) — f(xo)| = 0 < € for any epsilon. Therefore, every function is continuous at an isolated point 
of its domain. 


To study continuity at limit points of D, we have the following theorem which follows directly 


from the definitions of continuity and limit. 


Theorem 3.3.2 Let f: D— R and let x9 € D be a limit point of D. Then f is continuous at x9 if 
and only if 


lim f(x) = f (20). 


xX 


= Example 3.3.2 Let f: R — R be given by f(x) = 3x” —2x+1. Fix x9 € R. Since, from the 
results of the previous theorem, we have 


lim f(x) = lim (3x* —2x+1) = 3x2 — 2x) +1= f (x0), 
xX XX 
it follows that f is continuous at x9. 
The following theorem follows directly from the definition of continuity, Theorem 3.1.2 and 
Theorem 3.3.2 and we leave its proof as an exercise. 
Theorem 3.3.3 Let f: D— R and let x9 € D. Then f is continuous at xo if and only if for any 
sequence {x;,} in D that converges to xo, the sequence { f(x;)} converges to f (x0). 


The proofs of the next two theorems are straightforward using Theorem 3.3.3. 


Theorem 3.3.4 Let f,g: D— R and let x9 € D. Suppose f and g are continuous at x9. Then 
(a) f+g and fg are continuous at x9. 
(b) cf is continuous at x9 for any constant c. 


(c) If g(xo) 40, then f (defined on D = {x € D: g(x) 4 0}) is continuous at xo. 
§ 


Proof: We prove (a) and leave the other parts as an exercise. We will use Theorem 3.3.3. Let {x,} 
be a sequence in D that converges to x9. Since f and g are continuous at xo, by Theorem 3.3.3 we 
obtain that { f(x;,)} converges to f(x) and {g(x,)} converges to g(xo). By Theorem 2.2.1 (a),we 
get that {f (xx) + g(x~)} converges to f(xo) + g(xo). Therefore, 


lim (f +8) (%x) = him f (xx) + 8 (ae) = F(%0) +.8(%0) = (F + 8) 0).- 


Since {x;,} was arbitrary, using Theorem 3.3.3 again we conclude f + g is continuous at xo. 


Theorem 3.3.5 Let f: D— R and let g: E + R with f(D) CE. If f is continuous at x and g is 
continuous at f (xo), then go f is continuous at x9. 
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Exercises 


3.3.1 Prove, using definition 3.3.1, that each of the following functions is continuous on the given 
domain: 


(a) aan a,b ER, onR. 
(b) f(x) =x*-3onR. 
(c) ca dae [0, °°). 
(@) f(x) = + on R\ {0}. 


3.3.2 Determine the values of x at which each function is continuous. The domain of all the 
functions is R. 


sinx . ; 
@ feat a TP 
1, ifx=0. 
sinx 
if . 
o) fay=4 ei? NX? 
i. ifx—0. 
oP ee 
iy #0N= xsin~, if x £0; 
0, ifx=0. 
1 : 
(d) f(x) = cos, if |x| < 1; 
Ix—1], if x] > 1. 
(e) f(x) = lim sin Ee R 


3.3.3 Let f: IR — R be the function given by 


+a, if x>2; 
f(x) = ; 
ax—l1, if x<2. 


Find the value of a such that f is continuous. 


3.3.4 Let f: D— R and let x9 € D. Prove that if f is continuous at xo, then | f| is continuous at 
this point. Is the converse true in general? 


3.3.5 Prove Theorem 3.3.3. (Hint: treat separately the cases when xo is a limit point of D and when 
it is not.) 


3.3.6 Prove parts (b) and (c) of Theorem 3.3.4. 
3.3.7 Prove Theorem 3.3.5. 


3.3.8 > Explore the continuity of the function f in each case below. 
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(a) Let g,h: [0,1] > R be continuous functions and define 
g(x), if xe Qn, 1]; 
(Oo 
h(x), if xe Qn 0, 1]. 


Prove that if g(a) = h(a), for some a € [0,1], then f is continuous at a. 
(b) Let f: [0,1] > R be the function given by 


{i if x € QN(0, 1]; 


P(x) = l—x, if xe Q°N[0,1). 


Find all the points on [0, 1] at which the function is continuous. 


3.3.9 > Consider the Thomae function defined on (0, 1] by 


1 
-, ifx= a p,q © N, where p and g have no common factors; 
fa=44 q 
0, if x is irrational. 
(a) Prove that for every € > 0, the set 
Ae = {x € (0, 1]: f(x) 2 €} 


is finite. 


(b) Prove that f is continuous at every irrational point, and discontinuous at every rational point. 


3.3.10 [> Consider k distinct points x1,x2,...,x% € IR, k > 1. Find a function defined on R that is 
continuous at each x;,i=1,...,k, and discontinuous at all other points. 


3.3.11 Suppose that f, g are continuous functions on R and f(x) = g(x) for all x € Q. Prove that 
f(x) = g(x) for allx ER. 


3.4 PROPERTIES OF CONTINUOUS FUNCTIONS 


Recall from Definition 2.6.3 that a subset A of R is compact if and only if every sequence {a,} 
in A has a subsequence {dp, } that converges to a point a € A. 


Theorem 3.4.1 Let D be a nonempty compact subset of R and let f: D— R be a continuous 
function. Then f(D) is a compact subset of R. In particular, f(D) is closed and bounded. 


Proof: Take any sequence {y,} in f(D). Then for each n, there exists a, € D such that y, = f(a,). 
Since D is compact, there exists a subsequence {a,, } of {a,} and a point a € D such that 


lim dn, =a € D. 
k—-yoo 

It now follows from Theorem 3.3.3 that 
lim y,, = lim f(an,) = f(a) € f(D). 
k- 00 k-00 


Therefore, f(D) is compact. 
The final conclusion follows from Theorem 2.6.5 
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Definition 3.4.1 We say that the function f: D— R has an absolute minimum at x € D if 
f(x) > f(*) for every x € D. 
Similarly, we say that f has an absolute maximum at x if 


f(x) < f(*) for every x € D. 


Figure 3.2: Absolute maximum and absolute minimum of f on [a, 5]. 


Theorem 3.4.2 — Extreme Value Theorem. Suppose f: D — R is continuous and D is a compact 
set. Then f has an absolute minimum and an absolute maximum on D. 


Proof: Since D is compact, A = f(D) is closed and bounded (see Theorem 2.6.5). Let 
m=infA = inf f(x). 
In particular, m € IR. For every n € N, there exists a, € A such that 
m<a,<m-+1/n. 
For each n, since a, € A = f(D), there exists x, € D such that a, = f(x,) and, hence, 
m< f(xn) <m+1/n. 


By the compactness of D, there exists an element x € D and a subsequence {x,, } that converges to 
x € Das k — ~, Because 


1 
m< f(Xn,) <m-+ — for every k, 

Nk 
by the squeeze theorem (Theorem 2.1.6) we conclude lim;_.. f(%n,) =m. On the other hand, by 
continuity we have limy_... f (Xn, ) = f(%). We conclude that f(x) =m < f(x) for every x € D. Thus, 
f has an absolute minimum at x. The proof is similar for the case of absolute maximum. 


Remark 3.4.3 The proof of Theorem 3.4.2 can be shortened by applying Theorem 2.6.4. However, 
we have provided a direct proof instead. 


Corollary 3.4.4 If f: [a,b] > R is continuous, then it has an absolute minimum and an absolute 
maximum on [a,b]. 
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Corollary 3.4.4 is sometimes referred to as the Extreme Value Theorem. It follows immediately 
from Theorem 3.4.2, and the fact that the interval [a,b] is compact (see Example 2.6.4). 

The following result is a basic property of continuous functions that is used in a variety of 
situations. 


Lemma 3.4.5 Let f: D— R be continuous at c € D. Suppose f(c) > 0. Then there exists 6 > 0 
such that 


f(x) > 0 for every x € B(c;5) ND. 


Proof: Let ¢ = f(c) > 0. By the continuity of f at c, there exists 6 > 0 such that if x € D and 
|x —c| < 6, then 


If(x) — fle)| <€. 


This implies, in particular, that f(x) > f(c) — € =0 for every x € B(c;5) MD. The proof is now 
complete. 


Remark 3.4.6 An analogous result holds if f(c) < 0. 


Theorem 3.4.7 Let f: [a,b] + R be a continuous function. Suppose f(a) - f(b) < 0 (this means 
either f(a) <0 < f(b) or f(a) > 0 > f(b)). Then there exists c € (a,b) such that f(c) = 0. 


Proof: We prove only the case f(a) < 0 < f(b) (the case f(a) > 0 > f(b) is completely analogous). 
Define 


A= {x€ [a,b] : f(x) < 0}. 


This set is nonempty since a € A. This set is also bounded since A C |a,b]. Therefore, c = supA 
exists anda <c <b. We are going to prove that f(c) = 0 by showing that f(c) < 0 and f(c) >0 
lead to contradictions. 

Suppose f(c) < 0. Then there exists 6 > 0 such that 


f(x) <0 for all x € B(c; 5) M [a,b]. 


Because c < b (since f(b) > 0), we can find s € (c,b) such that f(s) < 0 (indeed s = min{c + 
6/2,(c+b)/2} will do). This is a contradiction because s € A and s > c. 
Suppose f(c) > 0. Then there exists 6 > 0 such that 


f(x) > 0 for all x € B(c; 5) 9 [a,b]. 
Since a < c (because f(a) < 0), there exists t € (a,c) such that f(x) > 0 for all x € (t,c) (in fact, 


t = max{c—6/2,(a+c)/2} will do). On the other hand, since t < c = supA, there exists t! € A 
with t < ¢’ <c. But thent <?’ and f(t’) < 0. This is a contradiction. We conclude that f(c) = 0. 


Theorem 3.4.8 — Intermediate Value Theorem. Let f: [a,b] — R be a continuous function. 
Suppose f(a) < y < f(b). Then there exists a number c € (a,b) such that f(c) = y. 
The same conclusion follows if f(a) > y > f(b). 
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f(x) 


Figure 3.3: Illustration of the Intermediate Value Theorem. 


Proof: Define 
Q(x) = f (x) ~~ Y; xE [a, b]. 


Then @ is continuous on [a,b]. Moreover, 


By Theorem 3.4.7, there exists c € (a,b) such that @(c) = 0. This is equivalent to f(c) = y. The 
proof is now complete. 


Corollary 3.4.9 Let f: [a,b] + R be a continuous function. Let 
m=min{ f(x) : x € [a,b]} and M = max{ f(x) : x € [a,bd]}. 


Then for every y € |m,M], there exists c € [a,b] such that f(c) = . 


a Example 3.4.1 We will use the Intermediate Value Theorem to prove that the equation e* = —x 
has at least one real solution. We will assume known that the exponential function is continuous on 
R and that e* < 1 forx <0. 

First define the function f: R— R by f(x) = e*+.x. Notice that the given equation has a 
solution x if and only if f(x) =0. Now, the function f is continuous (as the sum of continuous 
functions). Moreover, note that f(—1) = e~!+(—1) <1—1=0 and f(0) =1> 0. We can now 
apply the Intermediate Value Theorem to the function f on the interval [—1,0] with y = 0 to conclude 
that there is c € [—1,0] such that f(c) = 0. The point c is the desired solution to the original equation. 


a Example 3.4.2 We show now that, given n € N, every positive real number has a positive n-th root. 
Let n € N and let a € R with a > 0. First observe that (1+ a)” > 1-+na > a (see Exercise 1.3.7). 
Now consider the function f: [0,0c) + R given by f(x) =x". Since f(0) =0 and f(1+<a) >a, it 
follows from the Intermediate Value Theorem that there is x € (0,1 +a) such that f(x) =a. That is, 
x" = a, as desired. (We show later in Example 4.3.1 that such an x is unique.) 


We present below a second proof of Theorem 3.4.8 that does not depend on Theorem 3.4.7, but, 
instead, relies on the Nested Intervals Theorem (Theorem 2.3.3). 
Second Proof of Theorem 3.4.8: We construct a sequence of nested intervals as follows. Set 
a, =a, b; =b, and let J; = [a,b]. Let c} = (a+b)/2. If f(c1) = y, we are done. Otherwise, either 


Cen wg or 
f(a) <7. 
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In the first case, set az = a, and b; =). In the second case, set az = c; and by = by. Now set 
I, = [az, bz]. Note that in either case, 


f (a2) << f(b2). 
Set co = (a2 + bz) /2. If f(c2) = y, again we are done. Otherwise, either 


fie) > or 
Pia <y. 


In the first case, set a3 = a2 and b3 = cp. In the second case, set a3 = cz and b3 = by. Now set 
I; = [a3,b3]. Note that in either case, 


f (a3) < Y< f(b3). 


Proceeding in this way, either we find some c,,, such that f (cp, ) = y and, hence, the proof is complete, 
or we construct a sequence of closed bounded intervals {J,} with J, = [a,,b,]| such that for all n, 
OL5i 
(ii) Dy — Gn = (b—2)/2"-1, and 
(iii) f (an) << f (Dn). 
In this case, we proceed as follows. Condition (ii) implies that lim,_,..(bn — dn) = 0. By the Nested 
Intervals Theorem (Theorem 2.3.3, part (b)), there exists c € [a,b] such that (| J, = {c}. Moreover, 
as we see from the proof of that theorem, a, — c and by > casn—- ©, 

By the continuity of f, we get 


lim f(a,) = f(c) and 
tim f(bn) = f(c). 


Since f(an) < ¥ < f(bn) for all n, condition (iii) above and Theorem 2.1.5 give 


figsy and 
fle) 2 ¥. 


It follows that f(c) = y. Note that, since f(a) < y < f(b), then c € (a,b). The proof is now 
complete. 


Now we are going to discuss the continuity of the inverse function. For a function f: D— E, 
where E is a subset of IR, we can define the new function f: D — R by the same function notation. 
The function f: D — E is said to be continuous at a point x € D if the corresponding function 
f: D— Ris continuous at x. 


Theorem 3.4.10 Let f: [a,b] — R be strictly increasing and continuous on {a,b]. Let c = f(a) and 
d= f(b). Then f is one-to-one, f([a,b]) = [c,d], and the inverse function f~! defined on [c,d] by 


f-' (f(x) =x where x € [a,b], 


is a continuous function from [c,d] onto [a,b]. 
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Proof: The first two assertions follow from the monotonicity of f and the Intermediate Value 
Theorem (see also Corollary 3.4.9). We will prove that f~! is continuous on [c,d]. Fix any ¥ € [c,d] 
and fix any sequence {y,;} in [c,d] that converges to y. Let x € [a,b] and x; € [a,b] be such that 


f(x) =y and f(x,) = yz for every k. 


Then f~'(y) = and f~!(y,) = xz for every k. Suppose by contradiction that {x;,} does not converge 
to x. Then there exist &) > 0 and a subsequence {x,,} of {x,} such that 


|xx, —X| > & for every @. (3.7) 


Since the sequence {x,,} is bounded, it has a further subsequence that converges to xo € [a,b]. To 
simplify the notation, we will again call the new subsequence {x,,}. Taking limits in (3.7), we get 


|xo —%| > & > 0. (3.8) 


On the other hand, by the continuity of f, {f(x,,)} converges to f(x). Since f(xx,) = ye, > ¥ as 
£— ©, it follows that f (xo) = ¥ = f(*). This implies x9 = x, which contradicts (3.8). 


Remark 3.4.11 A similar result holds if the domain of f is the open interval (a,b) with some 
additional considerations. If f: (a,b) — R is increasing and bounded, following the argument 
in Theorem 3.2.4 we can show that both lim,_,,+ f(x) = c and lim,_,,- f(x) = d exist in R (see 
Exercise 3.2.10). Using the Intermediate Value Theorem we obtain that f((a,b)) = (c,d). We can 
now proceed as in the previous theorem to show that f has a continuous inverse from (c,d) to (a,b). 

If : (a,b) — Ris increasing, continuous, bounded below, but not bounded above, then lim,_,,+ f(x) = 
c ER, but lim,_,,- f(x) = e (again see Exercise 3.2.10). In this case we can show using the Inter- 
mediate Value Theorem that f((a,b)) = (c,cc) and we can proceed as above to prove that f has a 
continuous inverse from (c,°°) to (a,b). 

The other possibilities lead to similar results. 


A similar theorem can be proved for strictly decreasing functions. 


Exercises 


3.4.1 Let f: D— R be continuous at c € D and let y€ R. Suppose f(c) > y. Prove that there 
exists 6 > 0 such that 


f(x) > y for every x € B(c;5) ND. 


3.4.2 Let f,g be continuous functions on [a,b]. Suppose f(a) < g(a) and f(b) > g(b). Prove that 
there exists x € (a,b) such that f(xo) = g(x). 


3.4.3 Prove that the equation cosx = x has at least on solution in R. (Assume known that the 
function cosx is continuous.) 


3.4.4 Prove that the equation x* — 2 = cos(x+ 1) has at least two real solutions. (Assume known 
that the function cosx is continuous.) 


3.4.5 Let f: [a,b] — [a,b] be a continuous function. 


3.5 
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(a) Prove that the equation f(x) =x has a solution on [a, bj. 
(b) Suppose further that 


f(x) —fO)| < |x—y| for all x,y € [a,b],x Ay. 


Prove that the equation f(x) =x has a unique solution on [a, b]. 


3.4.6 (> Let f be a continuous function on [a,b] and x1,x2,...,%» € [a,b]. Prove that there exists 
c € [a,b] with 
f (x1) +f (x2) + FO 


3.4.7 (> Suppose f is a continuous function on R such that 
|f(x)| < |x| for all x 4 0. 


(a) Prove that f(0) =0. 
(b) Given two positive numbers a and b with a < b, prove that there exists ¢ € [0, 1) such that 


| f (x)| < |x| for all x € [a,b]. 
3.4.8 > Let f,g: [0,1] > [0,1] be continuous functions such that 


(g(a) = (F(a) for all x € [0,1]. 


Suppose further that f is monotone. Prove that there exists xg € [0,1] such that 


Ff (x0) = g(x0) = Xo. 


UNIFORM CONTINUITY 


We discuss here a stronger notion of continuity. 


Definition 3.5.1 Let D be a nonempty subset of R. A function f: D —> R is called uniformly 
continuous on D if for any € > 0, there exists 6 > 0 such that if u,v € D and |u—v| < 6, then 


If) -—f) <e. 
a Example 3.5.1 Any constant function f: D— R, is uniformly continuous on its domain. Indeed, 
given € > 0, |f(u) — f(v)| =0 < € for all u,v € D regardless of the choice of 6. 
The following result is straightforward from the definition. 
Theorem 3.5.1 If f: D— R is uniformly continuous on D, then f is continuous at every point 
xo € D. 


« Example 3.5.2 Let f: R — R be given by f(x) = 7x—2. We will show that f is uniformly 
continuous on R. 
Let € > 0 and choose 6 = €/7. Then, if u,v € R and |u—v| < 6, we have 


| f(u) — f(v)| = |7u—2— (7v—2)| =|7(u—v)| =7lu—v| < 76 =€. 
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» Example 3.5.3 Let f: [—3,2] — R be given by f(x) =x’. This function is uniformly continuous 
on [—3, 2]. 

Let € > 0. First observe that for u,v € [—3,2] we have |u+v| < |u| + |v| < 6. Now set 6 = €/6. 
Then, for u,v € [—3,2] satisfying |u — v| < 6, we have 


If(u) — F(v)| = |e? —v?| = |w—v|lu ty] < 6lu—v| < 65 =e. 


« Example 3.5.4 Let f: R > R be given by f(x) = 
continuous on R. 
Let € > 0. We observe first that 


ae We will show that f is uniformly 


w vet )=-v t+) le=viletvl — fev (lal +) 
w+1o v4i| (u? + 1)(v +1) ~ (w+1)(v?2 4-1) — (W241)? 41) 
Ju —v|((w? +1)+ (v2 +1)) ee ree. <2\u—v| 
= (u? + 1)(v +1) = v+1 0 w+1) — , 


(where we used that |x| < x? + 1 for all x € R, which can be easily seen by considering separately 
the cases |x| < 1 and |x| > 1). 
Now, set 6 = €/2. In view of the previous calculation, given u,v € R satisfying |u—v| < 6 we 


have 


uw v 


—— — —_| < 2|u- 26 =€. 
w+tl w+) Vaaed es 


If) -—FO)| = 


Definition 3.5.2 (Holder continuity). Let D be a nonempty subset of R. A function f: D— R is 
said to be Hélder continuous if there are constants 2 > 0 and @ > 0 such that 


|f (u) — f(v)| < elu—v|% for every u,v € D. 


The number @ is called the Hélder exponent of the function. If @ = 1, then the function f is called 
Lipschitz continuous. 


Theorem 3.5.2 Ifa function f: D — R is Hélder continuous, then it is uniformly continuous. 


Proof: Since f is Hélder continuous, there are constants ¢ > 0 and a@ > 0 such that 
|f (u) — f(v)| < elu—v|% for every u,v € D. 


If € =0, then f is constant and, thus, uniformly continuous. Suppose next that @ > 0. For any 
€>0,letd= Cae Then, whenever u,v € D, with |u — v| < 6 we have 


|f(u) — f(v)| < lu—v|% < 26% =. 


The proof is now complete. 


u Example 3.5.5 (1) Let D = [a,o), where a > 0. Then the function f(x) = /x is Lipschitz 
continuous on D and, hence, uniformly continuous on this set. Indeed, for any u,v € D, we 


have 
\u—v| 1 


I ee ba 


which shows f is Lipschitz with ¢ = 1/(2,/a). 


ju—vI, 
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Figure 3.4: The square root function. 


(2) Let D = [0,c0). Then f is not Lipschitz continuous on D, but it is Hélder continuous on D and, 
hence, f is also uniformly continuous on this set. 


Indeed, suppose by contradiction that f is Lipschitz continuous on D. Then there exists a 
constant £ > 0 such that 


|f(u) — f(v)| =|Vu- V0 < elu —v| for every u,v € D. 


Thus, for every n € N, we have 


1 1 
—-—0}<é/-— 0}. 
Fr EGE | 
This implies 
Vn <lorn< @ for everyn EN. 


This is a contradiction. Therefore, f is not Lipschitz continuous on D. 


Let us show that f is Hélder continuous on D. We are going to prove that 
|f(u) — f(v)| < |u—v|'/? for every u,v € D. (3.9) 
The inequality in (3.9) holds obviously for u = v = 0. For u > 0 or v > 0, we have 


If) — fF) = |vu- vv) 


Note that one can justify the inequality 


M+ 
vary 


by squaring both sides since they are both positive. Thus, (3.9) is satisfied. 


86 3,5 UNIFORM CONTINUITY 


While every uniformly continuous function on a set D is also continuous at each point of D, the 
converse is not true in general. The following example illustrates this point. 


u Example 3.5.6 Let f: (0,1) > R be given by 


Figure 3.5: Continuous but not uniformly continuous on (0,°°). 


We already know that this function is continuous at every x € (0,1). We will show that f is not 
uniformly continuous on (0,1). Let € = 2 and 6 > 0. Set d9 = min{6/2, 1/4}, x = do, and y = 26p. 
Then x,y € (0,1) and |x — y| = dp < 6, but 


_ | 
~~ Dee 


y-x 
xy 


1 1 
x y 


1 
=|x[22=8 


This shows f is not uniformly continuous on (0, 1). 


The following theorem offers a sequential characterization of uniform continuity analogous to 
that in Theorem 3.3.3. 


Theorem 3.5.3 Let D be a nonempty subset of R and f: D— R. Then f is uniformly continuous 
on D if and only if the following condition holds 

(C) for every two sequences {u,}, {v,} in D such that lim, ,..(Un — Vn) = 0, it follows that 
limyo0(f (Un) — f(Vn)) = 9. 

Proof: Suppose first that f is uniformly continuous and let {u,}, {v,} be sequences in D 
such that limp—..(Un — Vn) = 0. Let € > 0. Choose 6 > 0 such that |f(u) — f(v)| < € whenever 
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u,v € D and |u—v| < 6. Let N EN be such that |u, — v,| < 6 forn > N. For such n, we have 
|f(un) — f (vn)| < €. This shows lim, s0(f (Un) — f(vn)) = 0. 

To prove the converse, assume condition (C) holds and suppose, by way of contradiction, that f 
is not uniformly continuous. Then there exists &) > 0 such that for any 6 > 0, there exist u,v € D 
with 


|\u—v| < 6 and |f(u) — f(v)| > €. 
Thus, for every n € N, there exist u,,v, € D with 
|Un —Vn| < 1/nand |f(un) — f(vn)| = &0. 


It follows that for such sequences, limy—,.0(Un — Vn) = 0, but {f(un) — f(vn)} does not converge to 
zero, which contradicts the assumption. 


a Example 3.5.7 Using this theorem, we can give an easier proof that the function in Example 3.5.6 
is not uniformly continuous. Consider the two sequences u, = 1/(n+1) and v, = 1/n for all n > 2. 
Then clearly, lim, ,.0(Un — Vn) = 0, but 


Lim(F(un)— Fo) = fim (rege) ya) = hier tm) = 140 


The following theorem shows one important case in which continuity implies uniform continuity. 


Theorem 3.5.4 Let f: D— R be acontinuous function. Suppose D is compact. Then f is uniformly 
continuous on D. 


Proof: Suppose by contradiction that f is not uniformly continuous on D. Then there exists €) > 0 
such that for any 6 > 0, there exist u,v € D with 


|u—v| < 6 and | f(u) — f(v)| 2 €0. 
Thus, for every n € N, there exist u,,v, € D with 
ln —Vn| < 1/nand |f(un) — f(vn)| 2 €0- 
Since D is compact, there exist ug € D and a subsequence {u,, } of {u,} such that 
Un, —> Up as k — 0, 


Then , 
Un, — Vn,| < — 
Nk rte | — nk ’ 
for all k and, hence, we also have 
Vn, —> Up as k — 9, 


By the continuity of f, 
f(Un,) + f(uo) and f(vn,) + f (uo). 


Therefore, { f(Un,) — f(Vn,)} converges to zero, which is a contradiction. The proof is now com- 
plete. 
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We now prove a result that characterizes uniform continuity on open bounded intervals. We 
first make the observation that if f: D — R is uniformly continuous on D and A C D, then f is 
uniformly continuous on A. More precisely, the restriction f\4: A — R is uniformly continuous on A 
(see Section |.2 for the notation). This follows by noting that if |f(w) — f(v)| < € whenever u,v € D 
with |u—v| < 6, then we also have | f(u) — f(v)| < € when we restrict u,v to be in A. 


Theorem 3.5.5 Let a,b € R anda <b. A function f: (a,b) > R is uniformly continuous if and 
only if f can be extended to a continuous function f: [a,b] + R (that is, there is a continuous 
function f: [a,b] > R such that f = Fi(ab))- 


Proof: Suppose first that there exists a continuous function f: [a,b] + R such that f = f (a,b): By 
Theorem 3.5.4, the function f is uniformly continuous on [a,b]. Therefore, it follows from our early 
observation that f is uniformly continuous on (a,b). 

For the converse, suppose f: (a,b) — R is uniformly continuous. We will show first that 
lim,_a+ f(x) exists. Note that the one sided limit corresponds to the limit in Theorem 3.2.2. We will 
check that the €-6 condition of Theorem 3.2.2 holds. 

Let € > 0. Choose dy > 0 so that | f(u) — f(v)| < € whenever u,v € (a,b) and |u—v| < 6p. Set 
6 = 6)/2. Then, if u,v € (a,b), |u—a| < 6, and |v—a| < 6 we have 


Ju—v| < |u—al+la—v| <6 +65 =6 


and, hence, | f(u) — f(v)| < €. We can now invoke Theorem 3.2.2 to conclude lim,_,,,+ f(x) exists. 
In a similar way we can show that lim,_,,- f(x) exists. Now define, f: [a,b] > R by 


Fa); if x € (a,b); 
f(x) = 4 limy a+ f(x), ifx=a; 
lime 327 (4), tx: 


By its definition f (a,b) = f and, so, f is continuous at every x € (a,b). Moreover, lim,_,,+ f(x) = 
lim,_,,+ f(x) = f(a) and lim,_,,- f(x) =lim,_,,- f(x) = f(b), so f is also continuous at a and b by 
Theorem 3.3.2. Thus f is the desired continuous extension of f. 


Exercises 


3.5.1 Prove that each of the following functions is uniformly continuous on the given domain: 


(a) f(x) =ax+b,a,b ER, onR. 
(b) f(x) = 1/x on [a,cc), where a > 0. 


3.5.2 » Prove that each of the following functions is not uniformly continuous on the given domain: 
(a) f(x) =x onR. 
(b) f(x) = sins on (0, 1). 
(c) f(x) =In(x) on (0,2). 


3.5.3. Determine which of the following functions are uniformly continuous on the given domains. 
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(a) f(x) =xsin(+) on (0,1). 
(b) f(x) = —— on [0,~). 


~ x+1 
(c) f(x) = = ae (0, 1). 
(d) f(x) = lie (0,1). 


3.5.4 Let D C Randk ER. Prove that if f,g: D— R are uniformly continuous on D, then f + g 
and kf are uniformly continuous on D. 


3.5.5 Give an example of a subset D of R and uniformly continuous functions f,g: D— R such 
that fg is not uniformly conitnuous on D. 


3.5.6 Let D be a nonempty subset of IR and let f: D— R. Suppose that f is uniformly continuous 
on D. Prove that if {x,,} is a Cauchy sequence with x, € D for every n € N, then {f(x,)} is also a 
Cauchy sequence. 


3.5.7 > Let a,b € R and let f: (a,b) > R. 


(a) Prove that if f is uniformly continuous, then f is bounded. 


(b) Prove that if f is continuous, bounded, and monotone, then it is uniformly continuous. 
3.5.8 > Let f be a continuous function on [a, °°). Suppose 
lim f(x) =c. 
(a) Prove that f is bounded on |{a,c). 


(b) Prove that f is uniformly continuous on [a,°°). 
(c) Suppose further that c > f(a). Prove that there exists xo € [a,°°) such that 


f (x0) = inf{ f(x) x € [a,o)}. 


LIMIT SUPERIOR AND LIMIT INFERIOR OF FUNCTIONS 


We extend to functions the concepts of limit superior and limit inferior. 


Definition 3.6.1 Let f: E — R and let x be a limit point of D. Recall that 
Bo(x;6) = B_ (x; 6) UB, (x; 6) = (-— 6,x) U(%,*4+ 4). 
The limit superior of the function f at x is defined by 


limsup f(x) = inf sup f(x). 
XE 5>0 +EB9(#:5)ND 


Similarly, the limit inferior of the function f at x is defined by 


lim inf = inf . 
ee) Set 
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Consider the extended real-valued function g: (0,cc) — (—e9, 0] defined by 


g(6)= sup f(x). (3.10) 


X€Bo(%;6)ND 


It is clear that g is increasing and 


lim sup f(x) = inf g(6). 
6>0 


XK 


We say that the function f is locally bounded above around x if there exists 6 > 0 and M > 0 such 
that 


f(x) <M for all x € B(x;6) ND. 


Clearly, if f is locally bounded above around x, then limsup,_,; f(x) is a real number, while 
lim sup,.,; f(x) = in the other case. Similar discussion applies for the limit inferior. 


Theorem 3.6.1 Let f: D— R and let x be a limit point of D. Then @ = limsup,._,; f(x) if and only 
if the following two conditions hold: 


(1) For every € > 0, there exists 6 > 0 such that 
f(x) < £+€ for all x € Bo(%;6) ND; 
(2) For every € > 0 and for every 6 > 0, there exists xg € Bo(*;6) MD such that 
L—e< f(xs). 
Proof: Suppose ¢ = limsup,_,; f(x). Then 


é = inf g(d), 
inf 3( ) 


where g is defined in (3.10). For any € > 0, there exists 6 > 0 such that 


€<g(6)= sup f(x) <f+e. 
X€Bo(¥;5)ND 


Thus, 
f(x) < £+¢ for all x € Bo(%;5) ND, 
which proves condition (1). Next note that for any € > 0 and 6 > 0, we have 


l-e<l<g(d)= sup _ f(x). 
x€Bo(%;6)ND 


Thus, there exists x5 € Bo(x;6) OD with 
l—-e< f(xs). 


This proves (2). 
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Let us now prove the converse. Suppose (1) and (2) are satisfied. Fix any € > 0 and let 6 > 0 
satisfy (1). Then 


g(6)= sup f(x) <f+e. 
Xx€Bo(X;5)ND 


This implies 


lim sup f(x) = inf (9) <é+6. 


XK 


Since € is arbitrary, we get 


lim sup f(x) < @. 


XK 


Again, let € > 0. Given 6 > 0, let xs be as in (2). Therefore, 


f—e<f(xs)< sup f(x) =8(8). 


x€Bo(*#;5)ND 
This implies 


€—e< inf g(6) =limsup f(x). 
6>0 


XX 


It follows that @ < limsup,_,; f(x). Therefore, @ = limsup,, ,; f(x). 


Corollary 3.6.2 Suppose / = limsup,.,; f(x). Then there exists a sequence {x;} in D such that 
{x;,} converges to X, x, # X for every k, and 


lim f (xx) = @. 
k-y00 


Moreover, if {y,} is a sequence in D that converges to x, y, 4 X for every k, and limy_,.. f (yx) =, 


then @’ < £. 
1 
Proof: For each k € N, take & = k By (1) of Theorem 3.6.1, there exists 6; > 0 such that 


f(x) < £+& for all x € Bo(X; 6) ND. (3.11) 


Let 6; = min{ dx, i}: Then 6 < 6, and lim,_,.. dj = 0. From (2) of Theorem 3.6.1, there exists 
xx € Bo(%;6,) ND such that 


L— && SF ae 


Moreover, f(x;,) < + & by (3.11). Therefore, {x;,} is a sequence that satisfies the conclusion of the 
corollary. 

Now let {y;,} be a sequence in D that converges to X, y, # X for every k, and lim, ,.. f (yz) = &. 
For any € > 0, let 6 > 0 be as in (1) of Theorem 3.6.1. Since yy, € Bo(X;6) MD when k is sufficiently 
large, we have 


f(y) <f+€ 


for such k. This implies @’ < + €. It follows that f’ < 2. 
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Remark 3.6.3 Let f: D— R and let x be a limit point of D. Suppose limsup,_,; f(x) is a real 
number. Define 


A={lER:A{x,} C D, xy #X for every k, x, — x, f (xx) — £}. 
Then the previous corollary shows that A 4 0 and limsup,. ,; f(x) = maxA. 
Theorem 3.6.4 Let f: D— R and let x be a limit point of D. Then 


lim sup f(x) = 0 


XX 


if and only if there exists a sequence {x;} in D such that {x;,} converges to x, x, # X for every k, and 
limy5.00 Fixe) = 00, 


Proof: Suppose limsup,_,; f(x) = 0°. Then 


inf g(5) =<, 
inf ¢( ) 


where g is the extended real-valued function defined in (3.10). Thus, g(6) =o for every 6 > 0. 
1 
Given k EN, for 6 = PE since 


there exists x, € Bo(X; 6.) MD such that f(x;,) > k. Therefore, limp... f (x) = °°. 
Let us prove the converse. Since limy_,.. f (xz) = °°, for every M € R, there exists K € N such 
that 


f (xx) => M for every k> K. 
For any 6 > 0, we have 

X © Bo(x%36) AD 
whenever k is sufficiently large. Thus, 


o(3)= sup f(x) >M. 
Xx€Bo(X;5)ND 


This implies g(6) =», and hence limsup,_,; f(x) =. 
Theorem 3.6.5 Let f/: D— R and let x be a limit point of D. Then 


lim sup f(x) = —°o 


XX 


if and only if for any sequence {x;,} in D such that {x,} converges to x, x, 4 X for every k, it follows 
that lim... f (xz) = —°°. The latter is equivalent to lim,_,; f(x) = —ee. 


Following the same arguments, we can prove similar results for inferior limits of functions. 
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Theorem 3.6.6 Let f: D— R and let ¥ be a limit point of D. Then @ = liminf,_,; f(x) if and only 
if the following two conditions hold: 


(1) For every € > 0, there exists 6 > 0 such that 
€—e < f(x) for all x € Bo(x;6) ND; 
(2) For every € > 0 and for every 6 > 0, there exists x € Bo(*;6)MD such that 
f(x) <é+e. 


Corollary 3.6.7 Suppose @ = liminf,_,; f(x). Then there exists a sequence {x;} in D such that x, 
converges to X, x, 4X for every k, and 


lim f (xx) = @. 
k- 00 


Moreover, if {y,} is a sequence in D that converges to X, y, # X for every k, and limg_,.0 f(y,) = &, 
then @’ > £. 


Remark 3.6.8 Let f: D— R and let ¥ be a limit point of D. Suppose liminf,_,; f(x) is a real 
number. Define 


B={€ER: {xx} C D,xy £X for every k, x, — X, f (xz)  Z}. 
Then B ¥ 0 and liminfy_,; f(x) = minB. 
Theorem 3.6.9 Let f: D— R and let x be a limit point of D. Then 
liminf f(x) = 9 


if and only if there exists a sequence {x;,} in D such that {x,} converges to x, x, # X for every k, and 
limy_s00 f (xx) =F 29; 


Theorem 3.6.10 Let f: D— R and let x be a limit point of D. Then 


if and only if for any sequence {x;,} in D such that {x;,} converges to x, x, 4 X for every k, it follows 
that lim; 0. f (xz) = ce. The latter is equivalent to lim,_,; f(x) = ©. 


Theorem 3.6.11 Let f: D— R and let x be a limit point of D. Then 
lim f(x) =¢ 
if and only if 


lim sup f(x) = liminf f(x) = @. 
xXx 


XK 
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Proof: Suppose 
line y= ze: 


Then for every € > 0, there exists 6 > 0 such that 
l—e< f(x) < l+€ for all x € Bo(#;5) ND. 

Since this also holds for every 0 < 6’ < 6, we get 
l-€<g(6') <f+e. 

It follows that 


C—e< inf 9(5')<f+e. 
6’>0 


Therefore, limsup,_,; f(x) = @ since € is arbitrary. The proof for the limit inferior is similar. The 
converse follows directly from (1) of Theorem 3.6.1 and Theorem 3.6.6. 


Exercises 
3.6.1 LetD CR, f: DR, and x be a limit point of D. Prove that liminf,_,; f(x) < limsup,_,; f(x). 


3.6.2 Find each of the following limits: 
. {1 
(a) limsup,_,9 sin (<) ; 
x 


1 
(b) liminf, 9 sin (+) : 
x 


: cOsx 
(c) limsup,_,g ——. 
x 


(d) liminf,,9 *. 
XxX 


LOWER SEMICONTINUITY AND UPPER SEMICONTINUITY 


The concept of semicontinuity is convenient for the study of maxima and minima of some 
discontinuous functions. 


Definition 3.7.1 Let f: D— R and let x € D. We say that f is lower semicontinuous (L.s.c.) at x if 
for every € > 0, there exists 6 > 0 such that 


f(x) —€ < f(x) for all x € B(%;6)ND. (3.12) 


Similarly, we say that f is upper semicontinuous (u.s.c.) at X if for every € > 0, there exists 6 > 0 
such that 


f(x) < f(*) +€ for all x € B(#;5) ND. 


It is clear that f is continuous at x if and only if f is lower semicontinuous and upper semicontin- 
uous at this point. 
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Figure 3.6: Lower semicontinuity. 


Figure 3.7: Upper semicontinuity. 


Theorem 3.7.1 Let f: D— R and let x € D be a limit point of D. Then f is lower semicontinuous 
at x if and only if 


liminf f(x) > f(®). 
XX 
Similarly, f is upper semicontinuous at x if and only if 


limsup f(x) < f(x). 


XX 


Proof: Suppose f is lower semicontinuous at x. Let € > 0. Then there exists dp > 0 such that 


f(*) —€ < f(x) for all x € B(X; 69) ND. 


This implies 
where 
h(6) = inf . 
( oe 
Thus, 


liminf f(x) = suph(8) > h(&) > f() —€. 
xX7X 5>0 
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Since € is arbitrary, we obtain liminf,_,; f(x) > f(x). 
We now prove the converse. Suppose 


liminf f(x) = suph(6) > f() 
xX 5>0 


and let € > 0. Since 


suph(5) > f(x) —€, 
5>0 


there exists 6 > 0 such that h(6) > f(x) — €. This implies 
f(x) > f(*) —€ for all x € Bo(%;5) ND. 


Since this is also true for x = x, the function f is lower semicontinuous at x. 
The proof for the upper semicontinuous case is similar. 


Theorem 3.7.2 Let f: D— R and let x € D. Then ff is l.s.c. at x if and only if for every sequence 
{x;,} in D that converges to x, 


liminf f(x) > f(*). 
k- 00 
Similarly, f is u.s.c. at * if and only if for every sequence {x;,} in D that converges to x, 


lim sup f (xz) < f (2). 


k—yo0 


Proof: Suppose f is l.s.c. at ¥. Then for any € > 0, there exists 6 > 0 such that (3.12) holds. Since 
{x} converges to ¥, we have x, € B(x; 6) when k is sufficiently large. Thus, 


F(X) —€ < f(r) 


for such k. It follows that f(x) — € < liminfy_,.. f(x,). Since € is arbitrary, it follows that f(x) < 
lim infp_+.0 f (xx) : 

We now prove the converse. Suppose liminf;_,.. f (xz) > f(*) and assume, by way of contra- 
diction, that f is not l.s.c. at ¥. Then there exists € > 0 such that for every 6 > 0, there exists 
x5 € B(x;6) ND with 


f(@) —€ = f (xs). 

Applying this for 6 = _ we obtain a sequence {x;,} in D that converges to ¥ with 
f(x) —& > f (xx) for every k. 

This implies 


f(%) —€ > liminf f (x,). 


This is a contradiction. 
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Definition 3.7.2 Let f: D— R. We say that f is lower semicontinuous on D (or lower semicontinu- 
ous if no confusion occurs) if it is lower semicontinuous at every point of D. 


Theorem 3.7.3 Suppose D is a compact set of R and f: D— R is lower semicontinuous. Then f 
has an absolute minimum on D. That means there exists *« € D such that 


f(x) => f(x) for all x € D. 


Proof: We first prove that f is bounded below. Suppose by contradiction that for every k € N, there 
exists x; € D such that 


f (xx) <—k. 


Since D is compact, there exists a subsequence {x;,} of {x;,} that converges to x9 € D. Since f is 
Ls.c., by Theorem 3.7.2 


liminf f (xz,) > f (xo). 
L400 : 
This is a contraction because liminfy_,.. f (Xk, ) = —co, This shows f is bounded below. Define 
y = inf{f(x):x€ D}. 


Since the set { f(x) : x € D} is nonempty and bounded below, y € R. 
Let {u;} be a sequence in D such that { f(u,)} converges to y. By the compactness of D, the 
sequence {ux} has a convergent subsequence {u,,} that converges to some x € D. Then 


y= lim f(ug,) =liminf f(uy,) > f(®) > 7. 
L-00 lL c0 
This implies y = f(X) and, hence, 


f(x) => f(x) for all x € D. 


The proof is now complete. 


The following theorem is proved similarly. 


Theorem 3.7.4 Suppose D is a compact subset of R and f: D— R is upper semicontinuous. Then 
f has an absolute maximum on D. That is, there exists x € D such that 


f(x) < f(#) for all x € D. 
For every a € R, define 
La(f) = {xe D: f(x) <a} 
and 
Ua(f) = {x ED: f(x) 2 a}. 


Theorem 3.7.5 Let f: D— R. Then f is lower semicontinuous if and only if “%(f) is closed in D 
for every a € R. Similarly, f is upper semicontinuous if and only if %,(f) is closed in D for every 
a€ER. 
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Proof: Suppose f is lower semicontinuous. Using Corollary 2.6.10, we will prove that for every 
sequence {x,} in %,(f) that converges to a point x € D, we get X € Z(f). For every k, since 
xe € Lal(f), f(x) <a. 


Since f is lower semicontinuous at x, 
#8) <limint f(x) <a, 
—}co 


Thus, « € %,(f). It follows that Z%(f) is closed. 
We now prove the converse. Fix any x € D and € > 0. Then the set 


G={xeED: f(x) > f@)—€} =D\ Lrw_ecp) 

is open in D and x € G. Thus, there exists 6 > 0 such that 
B(x;6)A DCG. 

It follows that 


f(x) —€ < f(x) for all x € B(%;6)ND. 


Therefore, f is lower semicontinuous. The proof for the upper semicontinuous case is similar. 


For every a € R, we also define 
La(f) = {x € D: f(x) <a} 
and 
Ua(f) = {x € D: f(x) > a}. 


Corollary 3.7.6 Let f: D— R. Then f is lower semicontinuous if and only if U,(f) is open in D 
for every a € R. Similarly, f is upper semicontinuous if and only if L,(f) is open in D for every 
a€ER. 


Theorem 3.7.7 Let f: D— R. Then f is continuous if and only if for every a,b € R with a < b, 
the set 


Oub = {x €Dia< f(x) <b} =f '((a,b)) 
is an open set in D. 


Proof: Suppose f is continuous. Then f is lower semicontinuous and upper semicontinuos. Fix 
a,b € R witha < b. Then 


Oap = Lp Ug. 


By Theorem 3.7.6, the set Og» is open since it is the intersection of two open sets Lg and Up. 
Let us prove the converse. We will only show that f is lower semicontinuous since the proof of 
upper semicontinuity is similar. For every a € R, we have 


Ua(f) ={x © D: f(x) > a} =Unenf | ((a,a+n)) 


Thus, U,(f) is open in D as it is a union of open sets in D. Therefore, f is lower semicontinuous by 
Corollary 3.7.6. 
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Exercises 


3.7.1 Let f be the function given by 


x, We 0: 
FQ) = , if x=0. 


Prove that f is lower semicontinuous. 


3.7.2 Let f be the function given by 


x, if x40; 
w= ft if x=0. 


Prove that f is upper semicontinuous. 


3.7.3 Let f,g: D — R be lower semicontinuous functions and let k > 0 be a constant. Prove that 


f+g and kf are lower semicontinous functions on D. 
3.7.4 » Let f: R— R be a lower semicontinuous function such that 


lim f(x) = lim f(x) =~. 


X—}oo X—}—00 


Prove that f has an absolute minimum at some xo € R. 


4.1 


DEFINITION AND BASIC PROPERTIES OF THE DERIVA- 
TIVE 

THE MEAN VALUE THEOREM 

SOME APPLICATIONS OF THE MEAN VALUE THEOREM 
L’HOSPITAL’S RULE 

TAYLOR’S THEOREM 

CONVEX FUNCTIONS AND DERIVATIVES 
NONDIFFERENTIABLE CONVEX FUNCTIONS AND SUBD- 
IFFERENTIALS 


4. DIFFERENTIATION 


In this chapter, we discuss basic properties of the derivative of a function and several major 
theorems, including the Mean Value Theorem and |’ H6pital’s Rule. 


DEFINITION AND BASIC PROPERTIES OF THE DERIVATIVE 
Let G be an open subset of R and consider a function f: G— R. For every a € G, the function 


f(x) = f(a) 


x—a 


a(x) = 


is defined on G \ {a}. Since G is an open set, a is a limit point of G \ {a} (see Example 2.6.6). Thus, 
it is possible to discuss the limit 


Definition 4.1.1 Let G be an open subset of R and let a € G. We say that the function f defined on 
G is differentiable at a if the limit 


tim £0) £2) 


xa x-a 


exists (as a real number). In this case, the limit is called the derivative of f at a denoted by f’(a), 
and f is said to be differentiable at a. Thus, if f is differentiable at a, then 


Al. 


xa XxX a 


We say that f is differentiable on G if f is differentiable at every point a € G. In this case, the 
function f’: G— R is called the derivative of f on G. 
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a Example 4.1.1 (a) Let f: R— R be given by f(x) =x and let a € R. Then 


It follows that f is differentiable at a and f’(a) = 1. 
(b) Let f: R— R be given by f(x) =x and let a € R. Then 
f)-f@)_, P=@  (x—a)(x+a) 


= lim —— = lim ———— = lim (x+ a) =2a. 
. x a x-a x > a 


Thus, f is differentiable at every a € R and f’(a) = 2a. 
(c) Let f: R— R be given by f(x) = |x| and let a= 0. Then 


f(x) = FO) 


Ix] _ 


lim = lim — = lim -=1, 
x 0+ x—0 x9 0t xX x> OX 
and 5 
tim L-FO) ine Ae ig 1 
x 07 x—O0 x> 07 X x3 07 X 


Therefore, lim,_; 9 fof) does not exist and, hence, f is not differentiable at 0. 


Theorem 4.1.1 Let G be an open subset of R and let f be defined on G. If f is differentiable at 
aé€G, then f is continuous at this point. 


Proof: We have the following identity for x € G\ {a}: 


Therefore, f is continuous at a by Theorem 3.3.2. 


Remark 4.1.2 The converse of Theorem 4.1.1! is not true. For instance, the absolute value function 
f (x) = |x| is continuous at 0, but it is not differentiable at this point (as shown in the example above). 


Theorem 4.1.3 Let G be an open subset of R and let f,g: G— R. Suppose both f and g are 
differentiable at a € G. Then the following hold. 


(a) The function f+ g is differentiable at a and 
(f+8)'(a) = f(a) +8'(a). 
(b) For a constant c, the function cf is differentiable at a and 


(cf)'(a) =cf'(a). 
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(c) The function fg is differentiable at a and 
(f8)'(a) = f'(a)g(a) + f(a)s'(a). 


(d) Suppose additionally that g(a) 4 0. Then the function f is differentiable at a and 


(2) i= f'(a)a(a) — Fla)a'(a) 


Proof: The proofs of (a) and (b) are straightforward and we leave them as exercises. Let us prove (c). 
For every x € G\ {a}, we can write 


(fs)@)-(fs)@ _ f@)s(™) —fl@s) + F@s) — f(@s(@) 


xXx—a X—@ 


X—a X—a 


By Theorem 4.1.1, the function g is continuous at a and, hence, 


lim g(x) = g(a). (4.1) 


= f'(a)g(a) + f(a)g'(a). 


This implies (c). 
Next we show (d). Since g(a) 4 0, by (4.1), there exists an open interval J containing a such that 


g(x) £0 for allx€/. Leth= f Then h is defined on J. Moreover, 
§ 


n(x)—ha) _ HT at a 
x—a x—a 
ag if) - £@) + EEG (e(@) — 8(2)) 
- X—-a 
= tf g a) f(x) — f(a) f(a) g(x) — g(a) 
g(x)g(a) x—a x—a 


Taking the limit as x + a, we obtain (d). The proof is now complete. 


= Example 4.1.2 Let f: R — R be given by f(x) =x’ and let a € R. Using Example 4.1.1 (a) 
and Theorem 4.!.3(c) we can provide an alternative derivation of a formula for f’(a). Indeed, let 
g: RR be given by g(x) =x. Then f = g-g so 


f'(a) = (gg)'(a) = 8'(a)g(a) + 8(a)8'(a) = 28'(a)g(a) = 2a. 


Proceeding by induction, we can obtain the derivative of g: R — R given by g(x) = x" forn € N as 
2(a)= nx"—!, Furthermore, using this and Theorem 4.1.3(a)(b) we obtain the familiar formula for 
the derivative of a polynomial p(x) = apx" +---+aix+ao as p'(x) = nayx” |! +--+ 2a.x+ay. 
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The following lemma is very convenient for studying the differentiability of the composition of 
functions. 


Lemma 4.1.4 Let G be an open subset of R and let f: G— R. Suppose / is differentiable at a. 
Then there exists a function u: G > R satisfying 


f (x) — f(a) = [f’ (a) +u(x)](x— a) for all x € G 
and lim,_,_ u(x) = 0. 
Proof: Define 


u(x) = Ant - pa), x€G\ {a} 


0, x=a. 
Since f is differentiable at a, we have 


lim u(x) = lim fx)- f(a) 


xa xa x-a 


— f'(a) = f'(a)- f(a) =0. 


Therefore, the function u satisfies the conditions of the lemma. 


Theorem 4.1.5 — Chain rule. Let f: G; — R and let g: G2 — R, where G, and G» are two open 
subsets of R with f(G,) C Gz. Suppose f is differentiable at a and g is differentiable at f(a). Then 
the function go f is differentiable at a and 


(gof)'(a)=8'(f(@)f (@. 
Proof: Since f is differentiable at a, by Lemma 4.1.4, there exists a function u defined on G, with 
f (x) — f(a) = [f’(a) +u(x)] (x — a) for all x € G1, 


and lim, u(x) = 0. 
Similarly, since g is differentiable at f(a), there exists a function v defined on G2 with 


g(t) — 8(f(a)) = [e'(F(a)) + v(O)] lt — f(a)] for all t € Ga, (4.2) 


and lim,_, f(a) v(t) = 0. 
Applying (4.2) for t = f(x), we have 


a(f(x)) — 8(F(@)) = Is (F(@) + F@)IFR) — F(a). 
Thus, 

a(f(x)) —8(F(a)) = Is (F(@) + VF @)IF (@) + ua) (a — a) for all x € Gi. 
This implies 

(f(x) -~8F¢@) 


X= a4 


= [s'(F(a)) + v(F@))ILF (a) + u(x] for all x € Gi \ {a}. 
By the continuity of f at a and the property of v, we have lim,_,, v(f(x)) = 0 and, hence, 


in SEO =BI@) — zope sire 


xa X—-a 


The proof is now complete. 
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» Example 4.1.3 Consider the function 4: R — R given by h(x) = (3x4 +x+7)). Since h(x) isa 
polynomial we could in principle compute h'(x) by expanding the power and using Example 4.1.2. 
However, Theorem 4.1.5 provides a shorter way. Define f,g: IR > R by f(x) = 3x4+x+7 and 
g(x) =x). Then h = go f. Given a € R, it follows from Theorem 4.1.5 that 


(go f)'(a) = 8'(F(@))f (a) = 15(3a* +a+7)4(12a° + 1). 


a Example 4.1.4 By iterating the Chain Rule, we can extended the result to the composition of 
more than two functions in a straightforward way. For example, given functions f: G; > R, 
g: G2 > R, and h: G3; > R such that f(G;) C Go, g(G2) C G3, f is differentiable at a, g is 
differentiable at f(a), and h is differentiable at g(f(a)), we obtain that ho go f is differentiable at a 
and (hogo f)'(a) =h'(g(f(a)))8'(f(@)) f'@). 

Definition 4.1.2 Let G be an open set and let f: G — R be a differentiable function. If the function 
f': G— R is also differentiable, we say that f is twice differentiable (on G). The second derivative 
of f is denoted by f” or f?). Thus, f” = (f’)’. Similarly, we say that f is three times differentiable 
if f) is differentiable, and (f())’ is called the third derivative of f and is denoted by f” or f®). 
We can define in this way n times differentiability and the nth derivative of f for any positive integer 
n. As aconvention, f = f. 


Definition 4.1.3 Let 7 be an open interval in R and let f: 7—> R. The function f is said to be 
continuously differentiable if f is differentiable on J and f” is continuous on J. We denote by C!(J) 
the set of all continuously differentiable functions on /. If f is n times differentiable on J and the nth 
derivative is continuous, then f is called n times continuously differentiable. We denote by C" (I) the 
set of all times continuously differentiable functions on J. 


Exercises 
4.1.1 Prove parts (a) and (b) of Theorem 4.1.3. 


4.1.2 Compute the following derivatives directly from the definition. That is, do not use Theo- 
rem 4.1.3, but rather compute the appropriate limit directly (see Example 4.1.1). 


(a) f(x) =mx+b where m,b € R. 
(b) f(x) = : (here assume x # 0). 
(c) f(x) = x (here assume x > 0) 


4.1.3 Let f: R — R be given by 


x, ifx>0; 
x)= 
PO) é if x <0. 


(a) Prove that f is differentiable at 0. Find f’(x) for all x € R. 
(b) Is f’ continuous? Is f’ differentiable? 


4.1.4 Let 


x®, ifx>0; 
P(x) = ‘; if x<0. 
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(a) Determine the values of a for which f is continuous on R. 


(b) Determine the values of a for which f is differentiable on R. In this case, find f’. 


4.1.5 Use Theorems 4.1.3 and 4.1.5 to compute the derivatives of the following functions at the 
indicated points (see also Example 4.1.4). (Assume known that the function sin x is differentiable at 
all points and that its derivative is cos x.) 


3x4 +7 
@) fe) =Fa5 


(b) f(x) = sim (3x7 + Fx) ata= 3 


ata=—l. 


4.1.6 Determine the values of x at which each function is differentiable. 
1 

xsin-, ifx40; 
x 

0, ifx =O. 


(a) f(x) = 


1 

x’sin-, ifx 40; 
xX 

0, ifx=0, 


(b) f(x) = 


4.1.7 Determine if each of the following functions is differentiable at 0. Justify your answer. 


2 if : 
w= {eee 


(c) f(x) = cos(v/|x]). 
(d) f(x) =x\x|. 


4.1.8 Let f, g be differentiable at a. Find the following limits: 


(a) limy sa (a) — af (x) 
xXx—a 
(6) tim,.,, 18) — Flats) 


4.1.9 Let G be an open subset of R and a € G. Prove that if f{: G— R is Lipschitz continuous, 
then g(x) = (f(x) — f(a))” is differentiable at a. 


4.1.10 > Let f be differentiable at a and f(a) > 0. Find the following limit: 
n 
Fe Ce 
im | —_~ | . 
mie | Fla) 


1 
x sin —+-cx, if x £0; 
x 


0, if x=0, 


4.1.11 » Consider the function 


f(x) = 


4.2 
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where 0 <c < 1. 


(a) Prove that the function is differentiable on R. 
(b) Prove that for every @ > 0, the function f’ changes its sign on (—@, @). 


4.1.12 Let f be differentiable at xo € (a,b) and let c be a constant. Prove that 


(a) limp +07 [f(x0 + +) — f(x0)] = f’ (x0). 


f (x0 +h) — f (x0) 
h 


= cf! (xp). 


(b) limp+o 
4.1.13 Let f be differentiable at xo € (a,b) and let c be a constant. Find the limit 


Fam Lt0-+ ch) — Fto— ch) 
h-0 h 


4.1.14 Prove that f: R — R, given by f(x) = |x|>, is in C?(R) but not in C?(R) (refer to Defini- 
tion 4.1.3). (Hint: the key issue is differentiability at 0.) 


THE MEAN VALUE THEOREM 


In this section, we focus on the Mean Value Theorem, one of the most important tools of calculus 
and one of the most beautiful results of mathematical analysis. The Mean Value Theorem we study 
in this section was stated by the French mathematician Augustin Louis Cauchy (1789-1857), which 
follows from a simpler version called Rolle’s Theorem. 

An important application of differentiation is solving optimization problems. A simple method 
for identifying local extrema of a function was found by the French mathematician Pierre de Fermat 
(1601-1665). Fermat’s method can also be used to prove Rolle’s Theorem. 

We start with some basic definitions of minima and maxima. Recall that for a € R and 6 > 0, 
the sets B(a; 6), B+ (a;6), and B_(a;6) denote the intervals (a—6,a+4), (a,a+6) and (a—6,a), 
respectively. 


Definition 4.2.1 Let D be a nonempty subset of R and let f: D— R. We say that f has a local (or 
relative) minimum at a € D if there exists 6 > 0 such that 


f(x) > f(a) for all x € B(a;5) ND. 
Similarly, we say that f has a local (or relative) maximum at a € D if there exists 6 > 0 such that 
f(x) < f(a) for all x € B(a;5) ND. 


In January 1638, Pierre de Fermat described his method for finding maxima and minima in a 
letter written to Marin Mersenne (1588-1648) who was considered as “the center of the world of 
science and mathematics during the first half of the 1600s.” His method presented in the theorem 
below is now known as Fermat’s Rule. 


Theorem 4.2.1 — Fermat’s Rule. Let / be an open interval and f: J— R. If f has a local minimum 
or maximum at a € J and f is differentiable at a, then f’(a) = 0. 
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Figure 4.1: Illustration of Fermat’s Rule. 


Proof: Suppose f has a local minimum at a. Then there exists 6 > 0 sufficiently small such that 
f(x) = f(a) for all x € B(a; 5). 
Since B,(a;6) is a subset of B(a; 6), we have 


f(x) = f(a) 


> 0 for all x € B(a;5). 
x—a 


Taking into account the differentiability of f at a yields 


f@)-fla@) _ , fO-F@) 


‘(ae ti > 0. 
f (a) Pat x—a x—at xX—a ae 
Similarly, 


FE) I) < 9 for al x € B_(a38). 
X—a 


It follows that 


Therefore, f’(a) = 0. The proof is similar for the case where f has a local maximum at a. 


Theorem 4.2.2 — Rolle’s Theorem. Let a,b € R with a < b and f: |a,b] > R. Suppose f is 
continuous on |a,b] and differentiable on (a,b) with f(a) = f(b). Then there exists c € (a,b) such 
that 


fi(c) =0. (4.3) 


Proof: Since f is continuous on the compact set [a,b], by the extreme value theorem (Theorem 3.4.2) 
there exist <; € [a,b] and X2 € [a,b] such that 


f(%1) = min{ f(x) : x € [a,b] } and f (2) = max{ f(x) : x € [a,b] }. 
Then 


f(%1) < f(x) < f(%2) for all x € [a,b]. (4.4) 
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Figure 4.2: Illustration of Rolle’s Theorem. 


If <; € (a,b) or X2 € (a,b), then f has a local minimum at x; or f has a local maximum at x2. By 
Theorem 4.2.1, f’(¥,) =0 or f’(%2) =0, and (4.3) holds with c = x; or c = X. 

If both x; and x2 are the endpoints of [a,b], then f(<,) = f(X2) because f(a) = f(b). By (4.4), 
f is a constant function, so f’(c) = 0 for any c € (a,b). 


We are now ready to use Rolle’s Theorem to prove the Mean Value Theorem presented below. 


Figure 4.3: Illustration of the Mean Value Theorem. 


Theorem 4.2.3 — Mean Value Theorem. Let a,b € R with a < band f: [a,b] > R. Suppose f 
is continuous on [a,b] and differentiable on (a,b). Then there exists c € (a,b) such that 


pe LOL, 


Proof: The linear function whose graph goes through (a, f(a)) and (b, f(b)) is 


_ f)-¢(@) 
a(x) = 


(4.5) 


a) + f(a). 
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f (2) 
b 


f(@) 


a 


(x—a)+f(a)| for x € [a,b]. 


Then h(a) = h(b), and h satisfies the assumptions of Theorem 4.2.2. Thus, there exists c € (a,b) 
such that h'(c) = 0. Since 


Hs) = fe) - FOL), 
it follows that 
po LOO A 


Thus, (4.5) holds. 


« Example 4.2.1 We show that | sinx| < |x| for all x € R. 
Let f(x) = sinx for all x € R. Then f’(x) = cosx. Now, fix x € R, x > 0. By the Mean Value 
Theorem applied to f on the interval [0, x], there exists c € (0,x) such that 


sinx — sinO 
———— =cosc. 
x—0O 
| sin x| . ; 
Therefore, = |cosc|. Since |cosc| < 1 we conclude | sinx| < |x| for all x > 0. Next suppose 


|x| 


x <0. Another application of the Mean Value Theorem shows there exists c € (x,0) such that 


sin 0 — sinx 
——— =cosc. 
0=% 
__ | sinx| ; ; 
Then, again, r =|cosc| < 1. It follows that | sinx| < |x| for x < 0. Since equality holds for 
bs 


x = 0, we conclude that | sinx| < |x| for all x € R. 


u Example 4.2.2 We show that V1 + 4x < (5+ 2x) /3 for all x > 2. 
Let f(x) = V1+ 4s for all x > 2. Then 


oo 4. 
— O/1+4x 4/1440 


Now, fix x € R such that x > 2. We apply the Mean Value Theorem to f on the interval [2, x]. Then, 
since f(2) = 3, there exists c € (2,x) such that 


V¥14+4x—3= f’(c)(x—2). 


Since f’(2) = 2/3 and f’(c) < f’(2) for c > 2 we conclude that 


f(x) 


2 
v1+4x-3< 3 2) 


Rearranging terms provides the desired inequality. 


11] 


A more general result which follows directly from the Mean Value Theorem is known as Cauchy’s 
Theorem. 


Theorem 4.2.4 — Cauchy’s Theorem. Let a,b € R with a < b. Suppose f and g are continuous 
on [a,b] and differentiable on (a,b). Then there exists c € (a,b) such that 


[f(6) — f(a)]a'(c) = [8(6) -s(@)|f'(c)- (4.6) 
Proof: Define 
h(x) = [f(b) — f(a)]g(x) — [g() — g(a) fF) for x € [a,b]. 


Then h(a) = f(b)g(a) — f(a)g(b) = h(b), and h satisfies the assumptions of Theorem 4.2.2. Thus, 
there exists c € (a,b) such that h’(c) = 0. Since 


this implies (4.6). 


The following theorem shows that the derivative of a differentiable function on [a,b] satisfies the 
intermediate value property although the derivative function is not assumed to be continuous. To 
give the theorem in its greatest generality, we introduce a couple of definitions. 


Definition 4.2.2 Let a,b € R,a <b, and f: [a,b] > R. If the limit 
tim £2)-F() 


x—at x-a 


exists, we say that f has a right derivative at a and write 


fom ft 
If the limit 

im £0)-f0) 

x—b- x—b 


exists, we say that f has a left derivative at b and write 


fim £)- FO) 


x—>b- x—b 


f(b) = 


We will say that f is differentiable on [a,b] if f(x) exists for each x € (a,b) and, in addition, both 
fi.(a) and f! (b) exist. 


Theorem 4.2.5 — Intermediate Value Theorem for Derivatives. Let a,b € R with a < b. Sup- 
pose f is differentiable on [a,b] and 


fila) <a < fi (d). 


Then there exists c € (a,b) such that 


f(c)=A. 
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Figure 4.4: Right derivative. 


Proof: Define the function g: [a,b] + R by 
8(x) = f(x) — Ax. 

Then g is differentiable on [a,b] and 
8.(a) <0<g' (d). 

Thus, 


fam 8°) 82) 


x—at x—a 


<0. 


It follows that there exists 6; > 0 such that 
g(x) < g(a) for all x € (a,a+6,)N [a,b]. 
Similarly, there exists 6) > 0 such that 
g(x) < g(b) for all x € (b— &),b) O [a,b]. 


Since g is continuous on [a,b], it attains its minimum at a point c € [a,b]. From the observations 
above, it follows that c € (a,b). This implies g'(c) = 0 or, equivalently, that f’(c) =A. 


Remark 4.2.6 The same conclusion follows if f!.(a) >A > f(b). 
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Exercises 
4.2.1 {> Let f and g be differentiable at x9. Suppose f (x0) = g(xo) and 


f(x) < g(x) forallxeR. 


Prove that f’(xo) = g'(x0). 


4.2.2 Prove the following inequalities using the Mean Value Theorem. 


(a) Vl+x< 1+ 3x for x >0. 
(b) e* > 1+, for x > 0. (Assume known that the derivative of e* is itself.) 


—1 
(c) — <Inx < x—1, for x > 1. (Assume known that the derivative of Inx is 1/x.) 
x 
4.2.3 > Prove that | sin(x) — sin(y)| < |x—y| for all x,y € R. 


4.2.4 > Let n be a positive integer and let a,,b, € R for k = 1,...,n. Prove that the equation 
n 
x+ by (ax sinkx + by coskx) = 0 
k=1 


has a solution on (—7, 7). 


4.2.5 (> Let f and g be differentiable functions on [a,b]. Suppose g(x) 4 0 and g(x) £0 for all 
x € [a,b]. Prove that there exists c € (a,b) such that 


! f(a) f(b) | a 
g(b) —g(a)| g(a) (2) 


where the bars denote determinants of the two-by-two matrices. 


4.2.6 (>Let n be a fixed positive integer. 
(a) Suppose a1, d2,...,@y satisfy 


a2 


ars 


a 
+..." -09, 

n 
Prove that the equation 


ay taoxt+agx7+---+a,x" 1 =0 


has a solution in (0, 1). 


(b) Suppose ao, d1,...,d, Satisfy 


n 
ya ot 
A +1 


4.3 
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Prove that the equation 
n 
Y ag.cos(2k + 1)x = 0 
k=0 


has a solution on (0, 5). 


4.2.7 Let f: [0,00) > R bea differentiable function. Prove that if both lim,_,.. f(x) and lim,,.. f’ (x) 
exist, then limy,.. f’(x) = 0 


4.2.8 {> Let f: [0,0c) > R be a differentiable function. 


f(x) 


(a) Show that if lim,_,.. f’(x) =a, then lim,_,.. —— = a. 
< 


F(x) 


(b) Show that if lim,_,.. f’(x) =, then lim,_,.. ——+ = ce 
x 


(c) Are the converses in part (a) and part (b) true? 


SOME APPLICATIONS OF THE MEAN VALUE THEOREM 


In this section, we assume that a,b € R and a < b. In the proposition below, we show that it is 
possible to use the derivative to determine whether a function is constant. The proof is based on the 
Mean Value Theorem. 


Proposition 4.3.1 Let f be continuous on [a,b] and differentiable on (a,b). If f’(x) = 0 for all 
x € (a,b), then f is constant on [a,b]. 


Proof: Suppose by contradiction that f is not constant on [a,b]. Then there exist a, and b, such 
that a < a, <b; < band f(a1) F f(b1). By Theorem 4.2.3, there exists c € (a),b;) such that 


f(b1) — fla) 


bj —a, 


f(e)= 


which is a contradiction. 


#0, 


The next application of the Mean Value Theorem concerns developing simple criteria for 
monotonicity of real-valued functions based on the derivative. 


Proposition 4.3.2 Let f be differentiable on (a,b). 

(i) If f’(x) > 0 for all x € (a,b), then f is strictly increasing on (a,b). 

(ii) If f’(x) <0 for all x € (a,b), then f is strictly decreasing on (a,b). 

Proof: Let us prove (i). Fix any x1,x2 € (a,b) with x; < x2. By Theorem 4.2.3, there exists 

c € (x1,x2) such that 
Ff (x2) — fa) 


X2 —X] 


= f'(c)>0. 


This implies f(x;) < f(x2). Therefore, f is strictly increasing on (a,b). The proof of (ii) is similar. 
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Figure 4.5: Strictly Increasing Function. 


» Example 4.3.1 Let 1 € N and f: [0,0c) + R be given by f(x) =x". Then f’(x) =nx"~!. There- 
fore, f’(x) > 0 for all x > 0 and, so, f is strictly increasing. In particular, this shows that every 
positive real number has exactly one n-th root (refer to Example 3.4.2). 


Theorem 4.3.3 — Inverse Function Theorem. Suppose f is differentiable on J = (a,b) and 
f' (x) £0 for all x € (a,b). Then f is one-to-one, f(J/) is an open interval, and the inverse function 
f-!: f(D) — Lis differentiable. Moreover, 
_ 1 
Cae) ree (4.7) 
(x) 
where f(x) = y. 
Proof: It follows from Theorem 4.2.5 that 
f(x) > 0 for all x € (a,b), or f’(x) < 0 for all x € (a,b). 
Suppose f’(x) > 0 for all x € (a,b). Then f is strictly increasing on this interval and, hence, it is 
one-to-one. It follows from Theorem 3.4.10 and Remark 3.4.11 that f(Z) is an open interval and f~! 
is continuous on f(/). 
It remains to prove the differentiability of the inverse function f—! and the representation of its 
derivative (4.7). Fix any ¥ € f(I) with ¥ = f(x). Let g = f~!. We will show that 


m8) — 86) _ 1 

yy yy F'() 
Fix any sequence {y,} in f(/) that converges to ¥ and y, 4 y for every k. For each y,, there exists 
xx € I such that f(x.) = yx. That is, g(y~) = xx for all k. It follows from the continuity of g that {x;} 
converges to x. Then 
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The proof is now complete. 


a Example 4.3.2 Let n € N and consider the function f: (0,0¢) + R given by f(x) =x". Then f 
is differentiable and f’(x) = nx"! £0 for all x € (0,0). It is also clear that f((0,0°)) = (0,9). It 
follows from the Inverse Function Theorem that f—! : (0,00) —> (0,0) is differentiable and given 
y € (0,°) 


Given y > 0, the value f~!(y) is the unique positive real number whose n-th power is y. We call 
f(y) the (positive) n-th root of y and denote it by y/y. We also obtain the formula 


Exercises 


4.3.1 (a) Let f: RR be differentiable. Prove that if f’(x) is bounded, then f is Lipschitz 
continuous and, in particular, uniformly continuous. 


(b) Give an example of a function f: (0,e¢) + R which is differentiable and uniformly continuous 
but such that f’(x) is not bounded. 


4.3.2 » Let f: R— R. Suppose there exist £ > 0 and a > 0 such that 
|f(u) — f(v)| < Qu—v|® for allu,veR. (4.8) 


(a) Prove that f is uniformly continuous on R. 
(b) Prove that if a@ > 1, then f is a constant function. 


(c) Find a nondifferentiable function that satisfies the condition above for a = 1. 
4.3.3 [> Let f and g be differentiable functions on R such that f(xo) = g(xo) and 
f' (x) < g(x) for all x > xo. 
Prove that 
f(x) < g(x) for all x > xo. 
4.3.4 Let f,g: R— R be differentiable functions satisfying 


(a) f(0) = 8(0) =1 


(b) f(@2) +0, g(x) > Oand LM), #) 


> 


f(x) ~ g(x) 


for all x. 


Prove that 


FQ). 8) 


g(1) FU)’ 


4.4 
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4.3.5 [> Let f be twice differentiable on an open interval J. Suppose that there exist a,b,c € I 
with a <b <c such that f(a) < f(b) and f(b) > f(c). Prove that there exists d € (a,c) such that 
f"(d) <0. 


4.3.6 [> Prove that the function f defined in Exercise 4.1.11 is not monotone on any open interval 
containing 0. 


L’HOSPITAL’S RULE 


We now prove a result that allows us to compute various limits by calculating a related limit 
involving derivatives. All four theorems in this section are known as I’Hospital’s Rule. 
For this section, we assume a,b € R witha < b. 


Theorem 4.4.1 Suppose f and g are continuous on [a,b] and differentiable on (a,b). Suppose 
f (X) = g(x) = 0, where ¥ € [a,b]. Suppose further that there exists 6 > 0 such that g’(x) 4 0 for all 
x € B(x;6)N [a,b], x AX. 

If 


lim ss _) (4.9) 


Proof: Let {x;,} be a sequence in [a,b] that converges to * and such that x, 4 * for every k. By 
Theorem 4.2.4, for each k, there exists a sequence {c;,}, with cy, between x, and X, such that 


Lf Ore) — F@)18"(c) = [8 (xx) — 8@))F (ce). 
Since f(x) = g(x) = 0, and g'(c,) 4 0 for sufficiently large k, we have 
f(x) _ f'(ck) 


B(x) 8!(cK) 


Under the assumptions that g’(x) 4 0 for x near ¥ and g(*) = 0, we also have g(x;,) 4 0 for sufficiently 
large k. By the squeeze theorem (Theorem 2.1.6), {c,} converges to x. Thus, 


Therefore, (4.9) follows from Theorem 3.1.2. 


= Example 4.4.1 We will use Theorem 4.4.1 to show that 


2x + sinx _ 
x30 x243x 
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First we observe that the conditions of Theorem 4.4.1 hold. Here f(x) = 2x+sinx, g(x) =x? + 3x, 
and x = 0. We may take [a,b] = [—1,1], for example, so that f and g are continuous on [a,b] 
and differentiable on (a,b) and, furthermore, we is well defined on [a,b] \ {x}. Moreover, taking 
6 = 7/3, we get g/(x) = 2x +3 £0 for x € B(%;5)M [a,b]. Finally we calculate the limit of the 
quotient of derivatives using Theorem 3.2.1 to get 


eae) . 2+cosx lim, ,92+limy,9cosx 241 
lim = lim = : = = 1. 
xk g(x) x30 2x+3 lim,92x+3 3 
It now follows from Theorem 4.4.1 that lim, ao sinx — | as we wanted to show. 


a Example 4.4.2 We will apply L’Hospital’s rule to determine the limit 


‘ 3x3 — 2x7 +.4x—5 
im 
xol 4x4 27-2 


Here f(x) = 3x? — 2x? + 4x—5 and g(x) = 4x4 — 2x —2. Thus f(1) = (1) =0. Moreover, f’(x) = 
9x? — 4x +4 and g’(x) = 16x? —2. Since g’(1) = 14 4 0 and g’ is continuous we have g! (x) 4 0 for 
x near 1. Now, 


i Qx*-4x+4 9 
im = - 
x1 163-2 14 


Thus, the desired limit is ra as well. 


u Example 4.4.3 If the derivatives of the functions f and g themselves satisfy the assumptions of 
Theorem 4.4.1 we may apply L’Hospital’s rule to determine first the limit of f’(x)/g’(x) and then 
apply the rule again to determine the original limit. 
Consider the limit 
2 


lim : 
x0 1 —cosx 


Here f(x) =x’ and g(x) = 1 —cosx so both functions and all its derivatives are continuous. Now 
g' (x) = sinx and, so, g'(x) £0 for x near zero, x £0. Also, f’(0) =0 = g'(0) and g(x) =cosx £0 
for x near 0. Moreover, 


f"(x) 


x0 g(x)  x30cosx 


By L’Hospital’s rule we get 
f"(x) 


7 
ie ie i 
x0 g (x x0 g(x) x0 COSX 


Applying L Hospital’s rule one more time we get 


2 / 
Gp ae tie ie 
x30 1—cosx x30 g(x) x30 g/(x) 


= 2. 
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u Example 4.4.4 Let g(x) = x+3x" and let f: R — R be given by 


*sint, ifx #0; 
= {5 ifx=0. 


Now consider the limit 


1 


x 


x _ x sin 


lim F(x) = lim : 
x30 g(x) x30x+3x? 


Using the derivative rules at x £ 0 and the definition of derivative at x = 0 we can see that f is 
differentiable and 


2xsin + —cos? if x £0; 


roo={ Ap eaG, 


However, f’ is not continuous at 0 (since lim,_,9 f’ (x) does not exist) and, hence, L’ Hospital’s rule 
cannot be applied in this case. 


Ora | 
. x* sin = . 
On the other hand lim,_,9 sae does exist as we can see from 


1 
i 


x —_ _ 
ro0x+3x2  x50143x  limyso(1 +32) 


x? sin + _ xsin lim,_59xsin : 


Theorem 4.4.2 Let a,b € R,a <b, and x € (a,b). Suppose f,g: (a,b) \ {x} — R are differentiable 
on (a,b) \ {x} and assume lim,_,; f(x) = lim,_,; g(x) = ce. Suppose further that there exists 6 > 0 
such that g’(x) £0 for all x € B(x;5)M (a,b), x Ax. 


If €<€ R and 
ee é, (4.10) 
xk g!(x) 
then 
FX) _ (4.11) 


XK 2 x) 


Proof: Since lim,_,; f(x) = lim,,; g(x) = 0%, choosing a smaller positive 6 if necessary, we can 
assume that f(x) 4 0 and g(x) £0 for all x € B(x;5) (a,b). 


We will show that lim,_, ¢+ a) = ¢. The proof that lim,_, ;- f(z) = fis completely analogous. 
g(x 
Fix any € > 0. We need to find dy > 0 such that | f(x) /g(x) — @| < € whenever x € By (x; 69) 
(a,b). 
From (4.10), one can choose K > 0 and a positive 6; < 6 such that 
/ / 
F(x) < K and oh Be (4.12) 
g'(x) g(x) 2 


whenever x € B(X;61) (a,b), x AX. 
Fix a@ € By(x;6;) (a,b) (in particular, a > x). Since lim,_,; f(x) = 0%, we can find 6 > 0 
such that 62 < min{6,a@—<x} and f(x) ¢ f(a) for x € By (x; 62) 1 (a,b) = B+ (x; 62). Moreover, for 
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such x, since g’(z) #0 if x <z< @, Rolle’s theorem (Theorem 4.2.2) guarantees that g(x) 4 g(a). 
Therefore, for all x € B,(; 62) we can write, 


g(a) 

F(x) _ f@)—F(@) a(x) 

a(x) a(x)—g(a) , f(a) 
f(x) 

Now, define 
1 8(@) 
= g(x) orx€ x; 
Hg(x) f(a) fe B,( ; 62). 


Since lim,_,; f(x) = lim,_,¢ g(x) = ©°, we have that lim,_,;+ Ha(x) = 1. Thus, there exists a positive 
¥ < 6 such that 


E 
|Ho(x) —1| < TG whenever x € By (x;/7). 


For any x € B, (x; 7), applying Theorem 4.2.4 on the interval [x, a], we can write [ f(x) — f(@)]9’(c) = 
f' 


[g(x) — g(a@)|f’(c) for some c € (x, &) (note that, in particular, c € B(*: 6;)(a,b)). For such c we 
get 
fe) _ Op 
ge) sea 
Since c € B(x: 6;) (a,b), applying (4.12) we get that, for x € Ba (x;y) = Ba (*%y) (a,b), 
fe) |_| On 
wy = [ees eo) 4 
lO w@—y.£0 
= free) DF) 
nO flo) 
< eg Meo 4 
=< Ko =f : =€ 


Setting 69 = y completes the proof. 


= Example 4.4.5 Consider the limit 


Inx? 
im 
x30 J+ 


7s 
Ve 
Here f(x) = Inx?, g(x) =14+ ree X = 0, and we may take as (a,b) any open inteval containing 


0. Clearly f and g satisfy the differentiability assumptions and g’(x) 4 0 for all x 4 0. Moreover, 
lim,_,< f(x) = lim,_,; g(x) = 00. We analyze the quotient of the derivatives. We have 


V5 
ae ie = lim 3Vx2 =0. 
x 


x0 — x0 x 


win| NY 
oJ 
Sl 
th 


12] 


It now follows from Theorem 4.4.2 that 


Inx2 


im = 
x30 J+ Fa 

Remark 4.4.3 The proofs of Theorem 4.4.1 and Theorem 4.4.2 show that the results in these 
theorems can be applied for left-hand and right-hand limits. Moreover, the results can also be 
modified to include the case when x is an endpoint of the domain of the functions f and g. 


The following theorem can be proved following the method in the proof of Theorem 4.4.1. 
Theorem 4.4.4 Let f and g be differentiable on (a,c). Suppose g’(x) 4 0 for all x € (a,co) and 


lim f(x) = lim g(x) =0. 


xX—}oo xX—}oo 
If 2€ R and 
re) _, 
xv g(x)” 
then 
lim f(x) =f. 
x4 g(x) 


= Example 4.4.6 Consider the limit 


lim —————_——_.. 
x—veo x(F — arctanx) 


Writing the quotient in the form = Vx We can apply Theorem 4.4.4. We now compute the limit 
2 


—arctanx 
of the quotient of the derivatives 


In view of Theorem 4.4.4 the desired limit is also 1. 


The following theorem can be proved following the method in the proof of Theorem 4.4.2. 
Theorem 4.4.5 Let f and g be differentiable on (a,0c). Suppose g’(x) £0 for all x € (a,0°) and 


lim f(x) = lim g(x) = ©. 


xX—}oo xX—}oo 
If 2€ Rand 
ro _, 
xe gi(x) 7 
then 
m f(x) =. 


x4 g(x) 
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= Example 4.4.7 Consider the limit 


. Inx 
lim —. 
xX-poo X 


Clearly the functions f(x) = Inx and g(x) =x satisfy the conditions of Theorem 4.4.5. We have 


at ie 1? =o 


x—-y00 g! (x) x—300 | 


It follows from Theorem 4.4.5 that lim,_,.. nx = 0. 


Exercises 
4.4.1 Use L’ Hospital’s Rule to find the following limits (you may assume known all the relevant 
derivatives from calculus): 

x= Ax 


i ae = 2 


—x 


(a) Jim 


(b) lim 


x0 SINX cosx. 


OO eae ae V2 


e —e 
d) lim ———_.. 
( ) x90 In(1 +2) 


lim ; 

x1 sin(7x) 
4.4.2 For the problems below use L’ Hospital’s rule as many times as appropriate to determine the 
limits. 


. L—-cos2x 
(a) lim ———— 
x30 xsinx 
H\2 
xX peak 
(b) lim a3) 
x30 1 —sinx 
. X—arctanx 
c) lim : 
( ) x0 xe 
— sinx 


(d) lim 


x30 x—tanx 


4.4.3 Use the relevant version of L’Hospital’s rule to compute each of the following limits. 


3x2 +2x+7 
xo 4x? — 6x +17 


b) li ’ 
( ) Jim — cotx 


4.5 
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% —arctanx 


c) lim : 
© xe In(1 +4) 


(d) lim /xe~*. (Hint: first rewrite as a quotient.) 
X—}oo 
4.4.4 Prove that the following functions are differentiable at 1 and -1. 


Pe, if |x| <1; 


ee if |x| > 1. 

e 

arctanx, if |x| < 1; 
(b) f(x) = 


w —1 
q signx+ a if |x| > 1. 


4.4.5 {> Let P(x) be a polynomial. Prove that 
lim P(x)e* =0. 


4.4.6 » Consider the function 
1 
e “, ifx40; 
f(x) = ied 
0, if x=0. 


Prove that f € C”(R) for every n € N. 


TAYLOR’S THEOREM 
In this section, we prove a result that lets us approximate differentiable functions by polynomials. 
Theorem 4.5.1 — Taylor’s Theorem. Let 7 be a positive integer. Suppose f: [a,b] > R is a 


function such that f) is continuous on [a,b], and f("*!) (x) exists for all x € (a,b). Let ¥ € [a,d]. 
Then for any x € [a,b] with x # x, there exists a number c in between xX and x such that 


Proof: Let x be as in the statement and let us fix x 4 *. Since x —x # 0, there exists a number A € R 
such that 


A =\ n+ 
7) EO) aay . 


We will now show that 


haf), 
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for some c in between x and x. 
Consider the function 


k=0 


=\ __ * f(z) A =\n ay A y\n — 
£(9) = F00)— YP ah et = A) Fuld) — Gye = 
and 
n (K(x 
ats) =£00)— YP yt — Ean! = sla) F08) =0 


By Rolle’s theorem, there exists c in between < and x such that g’(c) = 0. Taking the derivative of 
g (keeping in mind that x is fixed and the independent variable is tf) and using the product rule for 
derivatives, we have 


ley = pte ee (oP FC) et) AG ae 
#0) = rio+¥ ( eet + FT eo | +do-0 
= A leet pr0(e\(x—o9" 
= 0. 


This implies A = f+!) (c). The proof is now complete. 


The polynomial P,(x) given in the theorem is called the n-th Taylor polynomial of f at x. 


Remark 4.5.2 The conclusion of Taylor’s theorem still holds true if x = x. In this case, c =x =X. 


a Example 4.5.1 We will use Taylor’s theorem to estimate the error in approximating the function 
f(x) = sinx with it 3rd Taylor polynomial at x = 0 on the interval [—2/2,7/2]. Since f’(x) = cosx, 


f" (x) = —sinx and f(x) = —cosx, a direct calculation shows that 
3 
x 
P3(x) =x—- 31° 


More over, for any c € R we have | f)(c)| = | sinc| < 1. Therefore, for x € [—1/2,2/2] we get (for 
some c between x and 0), 


(4) 2 
ee ee Oy < < 0.066. 


4! 


Theorem 4.5.3 Let be an even positive integer. Suppose f (”) exists and continuous on (a,b). Let 
X € (a,b) satisfy 


f' (® =... = f°) (%) =0 and f™ (x) £0. 


The following hold: 
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(a) f” (x) > 0 if and only if f has a local minimum at x. 
(b) f” (%) < 0 if and only if f has a local maximum at ¥. 


Proof: We will prove (a). Suppose f(”)(¥) > 0. Since f)(#) > 0 and f is continuous at X, there 
exists 6 > 0 such that 


f(t) > 0 for all t € B(x;5) C (a,b). 


Fix any x € B(x; 6). By Taylor’s theorem and the given assumption, there exists c in between < and x 
such that 


Since n is even and c € B(x;6), we have f(x) > f(x). Thus, f has a local minimum at x. 
Now, for the converse, suppose that f has a local minimum at x. Then there exists 6 > 0 such 
that 


f(x) => f(x) for all x € B(x; 5) C (a,b). 


Fix a sequence {x;,} in (a,b) that converges to with x, 4 x for every k. By Taylor’s theorem, there 
exists a sequence {c,}, with cy, between x; and x for each k, such that 


(n) 
: a (xx 


F(%«) = F@) + —¥)". 


Since x, € B(x; 6) for sufficiently large k, we have 
Ff (xx) = F@) 
for such k. It follows that 


(n)(¢ 
fle) £@) =D (aA D0. 


This implies f) (cg) > 0 for such k. Since {cx} converges to X, f” (¥) =limg,.. f (cx) > 0. 
The proof of (b) is similar. 


» Example 4.5.2 Consider the function f(x) =x? cosx defined on R. Then f’(x) = 2xcos.x—.x? sinx 


and f” (x) = 2cosx—4xsinx —x? cosx. Then f(0) = f’(0) =0 and f”(0) =2 > 0. It follows from 
the previous theorem that f has a local minimum at 0. Notice, by the way, that since f(0) = 0 and 
f(z) <0, 0 is not a global minimum. 


» Example 4.5.3 Consider the function f(x) = —x° + 2x° +.x4 — 4x? +. x? + 2x—3 defined on R. A 
direct calculations shows f’(1) = f”(1) =f” (1) = f (1) =0 and f© (1) <0. It follows from the 
previous theorem that f has a local maximum at 1. 


4.6 
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Exercises 


4.5.1 > Use Taylor’s theorem to prove that 


for allx >OandmeN. 


4.5.2 Find the Sth Taylor polynomial, P5(x), at ¥ = 0 for cosx. Determine an upper bound for the 
error |P5(x) — cosx| for x € [—2/2, 2/2]. 


4.5.3 Use Theorem 4.5.3 to determine if the following functions have a local minimum or a local 
maximum at the indicated points. 


(a) f(@) =2 sinx at x= 0. 
(b) f(x) =(1—x)Inxatx=1. 


4.5.4 Suppose f is twice differentiable on (a,b). Show that for every x € (a,b), 


tim f+) + Fle— A) ~2F(8) 


h-0 he 


= fi"). 


4.5.5 > (a) Suppose f is three times differentiable on (a,b) and x € (a,b). Prove that 


< FEAF Of O29 @= 7" 
ra a i oe 


(b) State and prove a more general result for the case where f is n times differentiable on (a,b). 


4.5.6 Suppose f is n times differentiable on (a,b) and x € (a,b). Define 


n h” 
- (n) (gr 
P,(h) =b (*)— forhe R 


Prove that 
h)—P,(h 
re Auaausiz awe 2 eer 
h>0 hn 


(Thus, we have 
f(E+h) = Pa(h) +8(A), 


gh) _ 


aw = 0. This is called the Taylor expansion with Peano’s 


wher g is a function that satisfies limy_,9 
remainder.) 


CONVEX FUNCTIONS AND DERIVATIVES 


We discuss in this section a class of functions that plays an important role in optimization 
problems. 


127 


fu) f--- 
Af(u) + (1— A) flv) from 
fQu+(1—A)v) fe 
Vv 


Figure 4.6: A Convex Function. 


Definition 4.6.1 Let J be an interval of R and let f: J — R. We say that f is convex on IJ if 
f(Au+(1—A)v) <Af(u) +(1—-A) f(r) 

for all u,v € J and for all A € (0,1). 

a Example 4.6.1 The following functions are convex. 


(a) f: ROR, f(x) =x. This is straightforward. 


(b) f: RR, f(x) =x°. Here note first that 2xy < x? + y for all real numbers x,y. Then, if 
0<A<1andx,yER, we get 


f(Ax+(1—A)y) (Ax+(1—A)y)? 

Ax? +201 —A)xy+(1 =A) yy" 

Ve eA AG ty yy 

= A(Ax?+(1—A)x*)+(1-A)(Ay* + (1—-A)y”) 
= Ax? +(1-A)y 


A f(x) + (1-4) FO). 


IA 


(c) f: R>R, f(x) = |x|. This follows from the triangle inequality and other basic properties of 
absolute value. 


Theorem 4.6.1 Let / be an interval of R. A function f: J — R is convex if and only if for every 
Ay 2 0,7 = 1yaae gn, with YA; = 1 @ = 2) and for every xp e 1, i= 1,..., 7% 


f (Ea = yay (4.13) 
i=l i=l 


Proof: Since the converse holds trivially, we only need to prove the implication by induction. The 
conclusion holds for n = 2 by the definition of convexity. Let k be such that the conclusion holds for 
any n with 2<n<k. We will show that it also holds forn =k+1. Fix A; > 0,i=1,...,k+1, with 
yi A; =1 and fix every x; €1,i=1,...,k+1. Then 


k 
Ay = 1 —An+1. 


i=1 


128 4.6 CONVEX FUNCTIONS AND DERIVATIVES 


If Ay+1 = 1, then A; = 0 for alli = 1,...,k, and (4.13) holds. Suppose 0 < Ay.1 < 1. Then, for each 
i= 1,...,k, Ai/ (1 — Ags) > 0 and 


a, 
1 1—Agyi 


It follows that 


k+l k Xi ‘ 
(a =sla Ags) REY <= Arse | 
i=1 ~ AK+I 


1 
ko 9. 

S(1—Apa lf (Fa) + Asif (X41) 

k Ai 
= (1-Agii) f (z i 4) + Asif (x41) 

= 

k Xi 
<i Aart) Ta + Nest (%e41) 
k+l 

= Vif (xi); 


where the first inequality follows from the definition of convexity (or is trivial if A;;; = 0) and the 
last inequality follows from the inductive assumption. The proof is now complete. 


Theorem 4.6.2 Let J be an interval and let f: J > R be a convex function. Then f has a local 
minimum at x if and only if f has an absolute minimum at x. 


Proof: Clearly if f has a global minimum at x, then it also has a local minimum at x. 
Conversely, suppose that f has a local minimum at x. Then there exists 6 > 0 such that 


f(u) > f(%) for all u € B(x; 6) I. 


For any x € I, we have x, = (1—+)¥+4x— %. Thus, x, € B(%;5)M/ when n is sufficiently large. 
Thus, for such n, 


f(8) < fl») < (1->)F(8) + — FQ). 


This implies that for a sufficient large n, we have 


(8) < “Fla 


and, hence, f(x) < f(x). Since x was arbitrary, this shows f has an absolute minimum at x. 


Theorem 4.6.3 Let J be an open interval and let f: J + R be a convex function. Suppose / is 
differentiable at x. Then 


f' (¥)(x-—£) < f(x) — f(%) for all x € 1. (4.14) 
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Proof: For any x € J and t € (0,1), we have 


FE+t(e—-))—-F@) _ flx+ (1—1)%) — f@) 


t t 
c tf) +1) fF) — fF) 
= t 


= f(x) - f@). 


Since f is differentiable at <x, 


f'(@(x—3) = lim LEH) - FH) 


t30t t 


< f(x) — f(), 


which completes the proof. 


Corollary 4.6.4 Let J be an open interval and let f: J — R be a convex function. Suppose f is 
differentiable at x. Then f has an absolute minimum at x if and only if f’(x) =0. 

Proof: Suppose f has an absolute minimum at *. By Theorem 4.2.1, f’(¥) = 0. Let us prove the 
converse. Suppose f’(<) = 0. It follows from Theorem 4.6.3 that 


0= f’(*)(x—*) < f(x) — f(&) for all x € 1. 
This implies 


f(x) => f(x) for all x € 1. 


Thus, f has an absolute minimum at x. 


Lemma 4.6.5 Let / be an open interval and suppose f: J — R is a convex function. Fix a,b,x € I 
with a <x <b. Then 


f@)-f@ - fO)-F@ - fO)-Fe). 


x—a b—-a b-x 


Proof: Let 


Then t € (0,1) and 


X—a 


—<(-4)] = f(a+t(b—a)) = f(th+(1—t)a). 


fix) = Fla+ a) =F (a4 
By convexity of f, we obtain 


f(x) Stf(b) + —t) f(a). 


Thus, 
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Equivalently, 
f)— fla) — fo)—f@) 
x-a ~— b-a ~ 
Similarly, 
f(x) — f(b) Stflb) + L-nf(@ — f(b) = 1 -LF@ — fF) = <—"F(0) — f(@)] 
It follows that 
f(O)—-F(@) — £(O)—F@) 
b-a ~— b-x © 


The proof is now complete. 
Theorem 4.6.6 Let J be an open interval and let f: J > R be a differentiable function. Then f is 
convex if and only if f’ is increasing on /. 

Proof: Suppose f is convex. Fix a < b with a,b € I. By Lemma 4.6.5, for any x € (a,b), we have 


fO-S@ - fO-f@) 


x—a == b-—a 


This implies, taking limits, that 


(a) FOF), 
Similarly, 
FOL) < pp, 


Therefore, f’(a) < f’(b), and f’ is an increasing function. 
Let us prove the converse. Suppose f’ is increasing. Fix x; < x2 andt € (0,1). Then 


Xp, < Xp < Xo, 


where x; = tx; + (1 —t)x2. By the Mean Value Theorem (Theorem 4.2.3), there exist cy and cz such 
that 


Xp <Cy << C2 << xX 


with 


This implies 


tf (x) —tf(m1) = f'(er)t(1 —t) (2 —m1); 
(1 —t) f(x) — (1—#) f (x2) = f’(c2)#(1 — 8) (m1 —22). 
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Since f’(c1) < f’(c2), we have 
tf (1) —tf (x1) = f (ert. 2) (2 —a1) Sf’ (ca)t(1— 8) G2 — 1) = (1-1) fz) — 1 -t) f (2). 
Rearranging terms, we get 


F(a) Sif) =f) fe). 


Therefore, f is convex. The proof is now complete. 


Corollary 4.6.7 Let 7 be an open interval and let f: J — R be a function. Suppose f is twice 
differentiable on J. Then f is convex if and only if f” (x) > 0 for all x € J. 

Proof: It follows from Proposition 4.3.2 that f”(x) > 0 for all x € / if and only if the derivative 
function f’ is increasing on J. The conclusion then follows directly from Theorem 4.6.6. 


» Example 4.6.2 Consider the function f: R > R given by f(x) = Vx*+1. Now, f(x) = 
x/Vx2 +1 and f”(x) = 1/(x? + 1)3/2. Since f(x) > 0 for all x, it follows from the corollary 
that f is convex. 


Theorem 4.6.8 Let / be an open interval and let f: J + R be a convex function. Then it is locally 
Lipschitz continuous in the sense that for any x € J, there exist > 0 and 6 > 0 such that 


|f(u) — f(v)| < Qu—y| for all u,v € B(x; 8). (4.15) 


In particular, f is continuous. 


Proof: Fix any x € J. Choose four numbers a,b,c,d satisfying 
a<b<x<c<dwithadel. 


Choose 6 > 0 such that B(x;6) C (b,c). Let u,v € B(x;6) with v < u. Then by Lemma 4.6.5, we 
see that 


fO)-f@ —fM-f@ —fM-fM — LO-FH) 


b u—a — u—v = d—-v d—c 


a 


Using a similar approach for the case u < v, we get 


< flu) — Ff) < FQ) — fle) 


a u—v = 


fe)- £@) for all u,v € B(z:8). 


b 


Choose @ > 0 sufficiently large so that 


pc) 


f(a) - fWM=-fY) - FO-FfO) 
< . 


a u—v —C 


< £ for all u,v € B(x; 6). 


Then (4.15) holds. The proof is now complete. 
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Exercises 


4.6.1 (a) Let J be an interval and let f,g: J + R be convex functions. Prove that cf, f+g, and 
max{f,g} are convex functions on J, where c > 0 is a constant. 
(b) Find two convex functions f and g on an interval J such that f- g is not convex. 


4.6.2 Let f: R — R be a convex function. Given a,b € R, prove that the function defined by 
g(x) = f(ax+b), forxe R 


is also a convex function on R. 


4.6.3 » Let J be an interval and let f: J + R be a convex function. Suppose that @ is a convex, 
increasing function on an interval J that contains f(/). Prove that @ o f is convex on J. 


4.6.4 (> Prove that each of the following functions is convex on the given domain: 


(x) 
(x) 
(c) f(x) =—In(1 =x), x € (—09, 1). 
(x) 
(x) 


er 
(d) f(x) = n(x R 
(e) {(4) =xsmzx, x € (—9,9) 


4.6.5 [> Prove the following: 


(a) If a,b are nonnegative real numbers, then 


b 
_ > vVab. 


(b) If aj,a2,...,dn, where n > 2, are nonnegative real numbers, then 


a tap +++ +a 
n 


> (ay +ag**a,,)"". 


4.7 NONDIFFERENTIABLE CONVEX FUNCTIONS AND SUBDIFFERENTIALS 


In this section, we introduce a new concept that is helpful in the study of optimization problems 
in which the objective function may fail to be differentiable. 


Definition 4.7.1 Let f: IR — R be a convex function. A number u € R is called a subderivative of 
the function f at x if 


u-(x—x) < f(x) — f(x) forallxeR. (4.16) 


The set of all subderivatives of f at ¥ is called the subdifferential of f at X and is denoted by 0 f(x). 
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Figure 4.7: A nondifferential convex function. 


a Example 4.7.1 Let f(x) = |x|. Then 
2 f(0) = [-1, 1) 
Indeed, for any u € 0 f(0), we have 
u-x=u(x—0) < f(x) — f(0) = |x| for allxeR. 
In particular, u- 1 < |1| = 1 andu-(—1) =—u<|-—1|=1. Thus, uv € [1,1]. It follows that 
df(0) c [-1,1]. 
For any u € [—1, 1], we have |u| < 1. Then 
u-x< |u-x| = |ul|x| < |x| for allxe R. 


This implies u € 0 f(0). Therefore, 0 f(0) = [—1, 1]. 


Lemma 4.7.1 Let f: IR— R be a convex function. Fix a € R. Define the slope function @, by 


$a(x) = fy fe) (4.17) 


for x € (—°,a) U (a,co). Then, for x1,x2 € (—°,a) U (a,c) with x1 < x2, we have 


da(x1) < a(x2). 


Proof: This lemma follows directly from Lemma 4.6.5. 


Theorem 4.7.2 Let f: IR — R be a convex function and let x € R. Then f has left derivative and 
right derivative at x. Moreover, 


sup Or(x) =f (8) <f,(8) = inf oe(x), 


X<*¥ 


where @; is defined in (4.17). 
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Figure 4.8: Definition of subderivative. 


Proof: By Lemma 4.7.1, the slope function @; defined by (4.17) is increasing on the interval (X, 0) 
and bounded below by ¢;(*— 1). By Theorem 3.2.4, the limit 


lim @;(x) = lim F(x) =F) 
xXET XRT x-X 


exists and is finite. Moreover, 


lim ¢(x) = inf gs(-x). 


X—Et Cx 


Thus, f’ () exists and 


fi. @= inf O<(x). 


Similarly, f’ (x) exists and 


f_(&) = sup (x). 


X<X 


Applying Lemma 4.7.1 again, we see that 


O;(x) < O:(y) whenever x <%<y. 


This implies f’ (x) < f! (x). The proof is complete. 
Theorem 4.7.3 Let f: R— R be a convex function and let x € R. Then 

Of(®) =[A@),A@). (4.18) 
Proof: Suppose u € 0 f(x). By the definition (4.16), we have 

u-(x—x) < f(x) — f() for all x > x. 
This implies 

p< fO-S0 


x-X 


for all x > x. 
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Similarly, we have 
u-(x—x) < f(x) — f(&) for all x < x. 

Thus, 

f(x) — f@) 


u> = 
X—-X 


for all x < x. 
This implies u > f" (x). So 
Of (x) C [f_@), fi, (®))- 
To prove the opposite inclusion, take u € [f! (x), f! (¥)]. By Theorem 4.7.2 


sup x(x) = fL(®) Su < fi, (®) = inf br(x). 


X<XK 


Using the upper estimate by f, (<) for u, one has 


u< O;(x) = fa)= Fe) for all x > x. 


Xx 


It follows that 
u-(x—x) < f(x) — f(&) for all x > x. 
Similarly, one also has 


u-(x—x) < f(x) — f() for all x < x. 


Thus, (4.16) holds and, hence, u € 0 f(x). Therefore, (4.18) holds. 


Corollary 4.7.4 Let f: R— R be a convex function and x € R. Then f is differentiable at x if and 
only if 0 f(x) is a singleton. In this case, 


Of (%) ={f'@}.- 
Proof: Suppose f is differentiable at x. Then 


LO=h.@=f @: 


By Theorem 4.7.3, 
Of (x) = [F.@), A. @] = {fF @}- 


Thus, 0 f(x) is a singleton. 
Conversely, if 0 f(X) is a singleton, we must have f’ (x) = f' (x). Thus, f is differentiable at x. 
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u Example 4.7.2 Let f(x) =a|x—b|-+c, where a > 0. Then f is a convex function and 
f(b) =a, fi,(b) =a. 

Thus, 
0 f(b) = [—a,al. 

Since f is differentiable on (—°°,b) and (b, °°), we have 


{-a}, ifx<b; 
Of (x) = 4 [-a,a], if x=); 
{a}, if x > b. 


Definition 4.7.2 Let A and B be two nonempty subsets of R and let a € R. Define 


A+B={a+b:a€A,b€ B} and aA ={aa:acA}. 


A B A+B 


Figure 4.9: Set addition. 


Theorem 4.7.5 Let f,g: IR— R be convex functions and let a > 0. Then f+ g and af are convex 
functions and 


(f+s)h@) =A @+s@) 
(f+s)_@) =f. @)+8_@). 


By Theorem 4.7.3, 


The proof for the second formula is similar. 
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a Example 4.7.3 Let a, < az <--- <a, and let uy; > 0 fori=1,...,n. Define 
n 
f(x) = Yo milx—ail. 
i=! 
Then f is a convex function. By Theorem 4.7.5, we get 


af) = eooae — Lae if F¢ {ar,....4n} 
Lace Lael + [—Hips Hip], if ¥ = aig. 
Theorem 4.7.6 Let fj: R- R,i=1,...,n, be convex functions. Define 
fix) =max{yi(a)ti—1,...,n} and) = {i= 1,...,72 fw) =s a}. 
Then f is a convex function. Moreover, 
f(z) = [m,M), 
where 


= min f!_(*) and M = re): 
m min f-) an max fi. (%) 


Proof: Fix u,v € R and A € (0,1). For any i= 1,...,n, we have 
fi(Au+(1—A)v) SAfi(u) + (L-A) filly) SAF(U) + 1 -A)S(Y). 
This implies 


f(Au+ (1—A)v) = max fi(Au+(1—A)v) <Af(u) + —-A)F(r). 


1<i<n 
Thus, f is a convex function. Similarly we verify that f" (<) = M and f! (x) =m. By Theorem 4.7.3, 


Of (x) = [m,M]. 


The proof is now complete. 


Remark 4.7.7 The product of two convex functions is not a convex function in general. For instance, 
f(x) =x and g(x) =x’ are convex functions, but A(x) =2° is not a convex function. 


The following result may be considered as a version of the first derivative test for extrema in the 
case of non differentiable functions. 


Theorem 4.7.8 Let f: IR — R be a convex function. Then f has an absolute minimum at x if and 
only if 


Oe Of(<) =(L@), A, @)].- 
Proof: Suppose f has an absolute minimum at x. Then 


f(%) < f(x) for allxeR. 
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This implies 
0-(x—x) =0< f(x) — f(x) forallxeR. 


It follows from (4.16) that 0 € Of (x). 
Conversely, if 0 € 0 f(X), again, by (4.16), 


0-(x-—x) =0< f(x) — f(x) forallxeR. 


Thus, f has an absolute minimum at x. 


a Example 4.7.4 Let k be a positive integer and a, < dz < +--+ < dpx_1. Define 
2k-1 


fx)= YL be-ail, 


i=l 


for x € R. It follows from the subdifferential formula in Example 4.7.3 that 0 € 0 f(x) if and only if 
X = a,x. Thus, f has a unique absolute minimum at ax. 


} 


Figure 4.10: Subdifferential of f(x) = 24>! |x—ail. 


Figure 4.11: Subdifferential of g(x) = Y?*, |x—ajl. 


Similarly, if a) < a2 < +++ < ax and 
2k 


g(x) =) be-all. 


i=l 
Then 0 € dg(x) if and only if * € [ay,ax+41]. Thus, g has an absolute minimum at any point of 
(ax, ae+1]. 
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The following theorem is a version of the Mean Value Theorem (Theorem 4.2.3) for nondifferen- 
tiable functions. 


Figure 4.12: Subdifferential mean value theorem. 


Theorem 4.7.9 Let f: IR — R be a convex function and let a < b. Then there exists c € (a,b) such 
that 


fO)- £0 € af(c). (4.19) 
Proof: Define 
sts) = 70) — [ALO oa) 4 ra). 


Then g is a convex function and g(a) = g(b). Thus, g has a local minimum at some c € (a,b) and, 
hence, g also has an absolute minimum at c. Observe that the function 


no) = - [A= 


pO sa) + F(a) 


is differentiable at c and, hence, 


an(e) = (W(} = {PFO 
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By Theorem 4.7.8 and the subdifferential sum rule, 


0 € dg(c) =ap(e)- {FO 


This implies (4.19). The proof is now complete. 


Corollary 4.7.10 Let f: R — R be a convex function. Then f is Lipschitz continuous if and only 
if there exists 2 > O such that 


Of (x) C [-£,4] for allxe R. 

Proof: Suppose f is Lipschitz continuous on R. Then there exists @ > 0 such that 
|f(u) — f(v)| < 2lu—v| for allu,ve R. 

Then for any x € R, 


PEM —FO) 2 yn Mel _ 


£. 
hot h ~ hoot h 
Similarly, f’ (x) > —é@. Thus, 
Of (x) = (FO), @)] C [-2,4]- 
Conversely, fix any u,v € R with u # v. Applying Theorem 4.7.9, we get 


AC) ee AC) 


v—-uUu 


Edaf(c) c[-64, 
for some c in between u and v. This implies 


If) —FO)| < elu—y. 


This inequality obviously holds for u = v. Therefore, f is Lipschitz continuous. 


Exercises 


4.7.1 (> Find subdifferentials of the following functions: 


(a) f(x) =alx|,a>0. 
(b) f(x) =|x—-1,)+|x+1]. 


4.7.2 Find the subdifferential of the function 
f(x) = max{—2x+1,x,2x— 1}. 


4.7.3 » Let f(x) = Y{_, |x—k]. Find all absolute minimizers of the function. 
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4.7.4 Let f: R— R be a convex function. Fix a,b € R and define the function g by 


g(x) = f(ax+b), forxe R 


Prove that 0g(x) = ad f(ax+b). 


4.7.5 {> Let f: R— R be a convex function. Suppose that 0 f(x) C [0,c¢) for all x € R. Prove that 


f is monotone increasing on R. 


5. Solutions and Hints for Selected Exercises 


SECTION 1.1 


Exercise 1.1.2. Applying basic rules of operations on sets yields 


PV nza=Pri2=—Z VY. 
and 
ZY NZ) = (2) YU Z)=(Z\ Y)U0=Z Vy. 


Therefore, (X \Y)NZ=Z\ (YNZ). 


SECTION 1.2 


Exercise 1.2.1. (a) For any a € A, we have f(a) € f(A) and, so, a € f~!(f(A)). This implies A C 
f '(f(A)). Note that this inclusion does not require the injectivity of f. Now fix any a € f-!(f(A)). 
Then f(a) € f(A), so there exists a’ € A such that f(a) = f(a’). Since f is one-to-one, a= a’ € A. 
Therefore, f—'(f(A)) C A and the equality holds. 


(b) Fix any b € f(f~'(B)). Then b = f(x) for some x € f~'(B). Thus, b = f(x) € B and, hence, 
f(f-'(B)) CB. This inclusion does not require the surjectivity of f. Now fix b € B. Since f is onto, 
there exists x € X such that f(x) =b € B. Thus, x € f~!(B) and, hence, b € f(f~'(B)). We have 
shown that B C f(f—!(B)) and the equality holds. 


Without the injectivity of f, the equality in part (a) is no longer valid. Consider f(x) =x’, x € R, 
and A = [—1,2]. Then f(A) = [0,4] and, hence, f~!(f(A)) = [—2,2], which strictly contains A. It is 
also not hard to find an example of a function f and a set B for which the equality in part (b) does 
not hold true. 


144 Solutions and Hints for Selected Exercises 


SECTION 1.3 


Exercise 1.3.6. For n = 1, 


1 pitvs_1-v5)_ 12V5_, 
zal p 2 laerre as 


Thus, the conclusion holds for n = 1. It is also easy to verify that the conclusion holds for n = 2. 
Suppose that 


oA E 


for all k <n, where n > 2. Let us show that 


1 14+f5\2+1 1—J5\n41 
oo ACS)" - 59)" 0 
J5 2 2 
By the definition of the sequence and the induction hypothesis, 
Ant = An + An-1 
AIS Salen" 
5 2 2 J5 2 2 
WCE A) - EY 
(4/5 2 2 2 2 
Observe that 
1+V75 3475 (14+V5\2__,1-V5 3-V5_ 1-v5\? 
b1= =a ) and +1= = Wie 
2 2 2 2 2 2 
Therefore, (5.1) follows easily. 
1 1- 
In this exercise, observe that the two numbers une and mel are the roots of the quadratic 
equation 
xv =x4+1. 


A more general result can be formulated as follows. Consider the sequence {a,} defined by 


a,j =a; 
a2 =b; 


An42 = Aan+1+ Pa, forneN. 


Suppose that the equation x = ax+ B has two solutions x; and x2. Let c; and c2 be two constants 
such that 


CiX1 + 02X72 = A; 


Cl (x1)? + €2 (x2)? = b. 
Then we can prove by induction that 


Xn = €1(x1)" +2(x2)”" for alln EN. 
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This is a very useful method to find a general formula for a sequence defined recursively as above. 
For example, consider the sequence 


An+2 = An41+2a, forn EN. 


* = x+2 yields two solutions x; = 2 and x. = (—1). Thus, 


Solving the equation x 
Xn = 12" +c2(-1)’, 


where c; and cp are constants such as 


@(2) +c(-1) =1; 
e122) +e(=1) =1. 


It is not hard to see that c} = 1/3 and cp = —1/3. Therefore, 


an = sot (-1)" for alln EN. 


Exercise 1.3.8. Hint: Prove first that, for k = 1,2,...,n, we have 


({) . ee 7 ea) 


Exercise 1.4.5. In general, to prove that |a| < m, where m > 0, we only need to show that a < m and 
-—a<m. 
For any x,y € R, 

|x| = |x-y+y| < |x-y| + |p, 
This implies 

|x| — [yl < |x—yI. 
Similarly, 

ly] = ly—x+2| < |x—y|+IaI, 
This implies 

—(|x|—|y]) < |x—-yI. 


Therefore, 


[xl —Iyll S [ex—yI. 
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SECTION 1.5 


Exercise 1.5.4. 

Let us first show that A + B is bounded above. Since A and B are nonempty and bounded above, 
by the completeness axiom, supA and supB exist and are real numbers. In particular, a < supA for 
alla € A and b < supB forall b€ B. 

For any x € A+B, there exist a € A and b € B such that x =a+b. Thus, x =a+b<supA-+supB, 
which shows that A + B is bounded above. 

We will now show that supA + sup B is the supremum of the set A+ B by showing that supA + 
sup B satisfies conditions (1°) and (2’) of Proposition 1.5.1. 

We have just shown that supA + supB is an upper bound of A+ B and, hence, supA + supB 
satisfies condition (1’). 

Now let € > 0. Using § in part (2”) of Proposition |.5.1 applied to the sets A and B, there exits 
a€Aandb €B such that 


E E 
supA— = <aand supB— = <b. 
2 2 
It follows that 
supA+supB—€ <a+b. 
This proves condition (2°). It follows from Proposition 1.5.1 applied to the set A+ B that supA + 
sup B = sup(A + B) as desired. 
SECTION 1.6 
1 
Exercise 1.6.2. Let x = —. By Theorem |.6.2(d), there exists m € Z such that 
r 


1 
m—-l<—-<m. 
r 


Since 1/r > 1, we get m > 1 and, so, m > 2. It follows that m— 1 € N. Set n = m-— | and then we 


get 
1 


n+1 


Sle 


<r< 


SECTION 2.1 
Exercise 2.1.12. (a) Suppose that lim,_,..d, = €. Then by Theorem 2.1.9, 


dim aon = fand dim don+1 =. (5.2) 
Now suppose that (5.2) is satisfied. Fix any € > 0. Choose N; € N such that 
|d2n — £| < € whenever n > Ni, 
and choose N2 € N such that 


|d2n41 — &| < € whenever n > Np. 
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Let N = max{2N,,2N2 +1}. Then 
|an — £| < € whenever n > N. 


Therefore, limy_,.. dy, = &. 


This problem is sometimes very helpful to show that a limit exists. For example, consider the 
sequence defined by 


= 1/2, 
1 
Xn+1 = te oe 
n 


We will see later that {x2,+,} and {x2,} both converge to /2 — 1, so we can conclude that {x,} 
converges to /2— 1. 


(b) Use a similar method to the solution of part (a). 


Exercise 2.1.8. Consider the case where £ > 0. By the definition of limit, we can find n; € N such 
that 


|an| > £/2 for alln > ny. 


Given any € > 0, we can find nz € N such that 
lan —£| < . for alln > mn. 


Choose no = max{nj,n2}. For any n > no, one has 


lan) + lant —€] EF 


a 
|an| 5 


an+1 ] = ln — An+1| 
an |dn| 


Therefore, lim, 5.0 Gt = |. If <0, consider the sequence {—a,}. 


The conclusion is no longer true if = 0. A counterexample is a, = A" where A € (0,1). 


SECTION 2.2 


Exercise 2.2.3. (a) The limit is calculated as follows: 


(vit Fn—n) (vit +n+n) 
lim (Vit +n—n) = lim 
n—-eoo n—-eo Vnz+tntn 
n 

= in —— 
ne /n2+n+n 
lim ” 
ne ,/n2(1+1/n)+n 


1 
= lim ——— = 1/2. 
neo 4/1 +1/n+1 / 
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(b) The limit is calculated as follows: 


(W/n3 + 3n? —n) (oe + 3n?)? + nv/n3 + 3n? +n?) 


lim (V8 one —n) =i 


n— oo n—oo ¢/(n3 + 3n?)? +nv773 + 3n2 +n?) 
: 3n? 
= lim ; 
n—oo 6/(n3 + 3n2)? + nn} + 3n? +n? 
= lim 3? 
neo ¥/6(1 +3 /n)? + ny/n3(1+3/n) +n? 
. 3n? 
= lim 
"= 2 (/(T+3/ny+ VO +3/n) +1) 
= lim : =]. 


nye (T+ 3/n? + /T¥3/n) +1) 
(c) We use the result in par (a) and part (b) to obtain 
Tim (73 + 3n? — Vir? +1) = lim (Vn +30? —n+n— +1) 
— lim (/n3 + 3n? —n) + lim (n- Vn? +1) iid: 


n-oo 


Using a similar technique, we can find the following limit: 


lim (Vand + br? + en +d — Jan? + Bn+7), 


noo 


where a > 0 and a > 0. 


SECTION 2.3 
Exercise 2.3.1. (a) Clearly, aj < 2. Suppose that a, < 2 fork € N. Then 


Ops = J2+a,<V¥24+2=2. 


By induction, a, < 2 foralln EN. 
(b) Clearly, a, = J2 <Y2+ J2 = d. Suppose that a, < ax, for k € N. Then 


Ap t2 < apy, +2, 


which implies 


fay +2 < Vay! +2. 
Thus, ag < a¢42. By induction, ay, < d,+; for alln € N. Therefore, {a,} is an increasing sequence. 


(c) By the monotone convergence theorem, lim,_,..d, exists. Let @ = limy,.0dy,. Since ay41 = 
V2+d, and limy+..dy+1 = &, we have 


l=V24+lor@=242. 
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Solving this quadratic equation yields 2 = —1 or £ = 2. Therefore, lim,_,..d, = 2. 
Define a more general sequence as follows: 
a,;=c>O0, 
Ang. =Vc+a, fornEeN. 
1+V1+4c 
2 
is obtained by solving the equation = c+, 


We can prove that {a,,} is monotone increasing and bounded above by . In fact, {ay} 


1+ V1+4c 
2 


converges to this limit. The number 
where @ > 0. 


Exercise 2.3.2. (a) The limit is 3. 
(b) The limit is 3. 
(c) We use the well-known inequality 
a+b+c 
3 


By induction, we see that a, > 0 for all n € N. Moreover, 


> Vabc for a,b,c => 0. 


1 1 1 1 1 
aGn+1 = 3 (24 7D? = 3 (6, ha >=/ 
n 


We also have, for n > 2, 


1 1 a+l (an —1)(a2 +-a,+1) 
tery = 5 (2en + 7) a= 3a = 3a? <0. 


Thus, {a,} is monotone deceasing (for n > 2) and bounded below. We can show that lim, ,..d, = 1. 


(d) Use the inequality web > Vab for a,b > 0 to show that ay, > Vb for all n € N. Then follow 
part 3 to show that {a,} is monotone decreasing. The limit is Vb. 


Exercise 2.3.3. (a) Let {a,} be the given sequence. Observe that a,+; = /2a,. Then show that 
{a,} is monotone increasing and bounded above. The limit is 2. 
(b) Let {a,} be the given sequence. Then 


1 


antl = Die 
nN 


Show that {a1} is monotone decreasing and bounded below; {a»,,} is monotone increasing and 
bounded above. Thus, {a,} converges by Exercise 2.1.12. The limit is 2 — 1. 


Exercise 2.3.5. Observe that 


b 
bv = OS "> Vanbp = dn for alln EN. 


Thus, 
An+1 = V anbn > VanGn = Gn for alln EN, 
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an + bn 2 bn + bn 
2 ~— 2 

It follows that {a,} is monotone increasing and bounded above by b;, and {b,} is decreasing and 

bounded below by a). Let x = limy_4..d, and y = limy_4.. by. Then 


=b, forallneN. 


batt = 


x= YAand y="? 


Therefore, x = y. 


SECTION 2.4 


Exercise 2.4.1. Here we use the fact that in R a sequence is a Cauchy sequence if and only if it is 
convergent. 
(a) Not a Cauchy sequence. See Example 2.1.7. 


(b) A Cauchy sequence. This sequence converges to 0. 
(c) A Cauchy sequence. This sequence converges to 1. 


(d) A Cauchy sequence. This sequence converges to 0 (see Exercise 2.1.5). 


SECTION 2.5 
Exercise 2.5.4. (a) Define 


On = sup(4n + bn), Bn = supa, Yr = sup Dr. 


k>n k>n k>n 


By the definition, 


limsup(a, + by) = lim Q, limsupa, = lim B,, limsupb, = lim yy. 
N—yoo noree N—yoo nee n—yoo nore 
By Exercise 2.5.3, 
On < Bn +Y%q for alln EN. 
This implies 


lim a, < lim B, + lim y, for alln EN. 
n-oo n—-o0o n—-oo 


Therefore, 
limsup(a, + b,) < limsupa, + limsupb,. 


noo n—-co n—-co 
This conclusion remains valid for unbounded sequences provided that the right-hand side is well- 
defined. Note that the right-hand side is not well-defined, for example, when limsup,,_,.. d, = c and 
lim SUP) 5.0 Pn = —©. 
(b) Define 
On = inf (an +bn), Bn = int ae, Yn = jot by. 


Proceed as in part (a), but use part (b) of Exercise 2.5.3. 
(c) Consider a, = (—1)”" and by = (—1)""1. 
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SECTION 2.6 


Exercise 2.6.3. Suppose A and B are compact subsets of R. Then, by Theorem 2.6.5, A and 
B are closed and bounded. From Theorem 2.6.2(c) we get that AUB is closed. Moreover, let 
Ma,ma, Mg,mp be upper and lower bounds for A and B, respectively. Then M = max{M,, Mp} 
and m = min{m,,mp} are upper and lower bounds for A UB. In particular, AUB is bounded. We 
have shown that A U B is both closed and bounded. It now follows from Theorem 2.6.5 that A U B is 
compact. 


SECTION 3.1 


Exercise 3.1.6. (a) Observe that when x is near 1/2, f(x) is near 1/2 no matter whether x is rational 
or irrational. We have 


|\x— 1/2], if xe Q; 
|l—x-1/2|, ifx¢Q 


Thus, | f(x) — 1/2| =|x—1/2| for all x ER. 
Given any € > 0, choose 6 = €. Then 


10) =| 


| f(x) — 1/2| < € whenever |x —1/2| < 6. 


Therefore, lim,_,1/2 f(x) = 1/2. 


(b) Observe that when x is near 0 and x is rational, f(x) is near 0. However, when f is near 0 and x 
is irrational, f(x) is near 1. Thus, the given limit does not exists. We justify this using the sequential 
criterion for limits (Theorem 3.1.2). By contradiction, assume that 

lim f(x) = 2, 

x0 
where ¢ is a real number. Choose a sequence {r,,} of rational numbers that converges to 0, and choose 
also a sequence {s,,} of irrational numbers that converges to 0. Then f(r,) =r, and f(s,) = 1—s» 


and, hence, 
l= hin f7,)=0 


n—-oo 


and 
f= fim jf (s,) = limi —s,) = 1. 
n—-eoo 


n—>oo 
This is a contradiction. 
(c) By a similar method to part (b), we can show that lim,_,; f(x) does not exists. 


Solving this problem suggests a more general problem as follows. Given two polynomials P and 
Q, define the function 


P(x), if xEeQ 
Q(x), ifx¢Q 


If a is a solution of the equation P(x) = Q(x), ie., P(a) = Q(a), then the limit lim,_,, f(x) exists 
and the limit is this common value. For all other points the limit does not exist. 
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Similar problems: 
1. Determine all a € R at which lim,_,, f(x) exists, where 


_ x, if xEQ; 
P(x) = ae if xex¢Q. 


2. Consider the function 


_f#t1, ifxeQ; 
P(x) = " ifxZQ. 


Prove that f does not have a limit at any a € R. 


SECTION 3.2 


Exercise 3.2.5. The given condition implies that if both x; and x2 are close to x, then they are close 


to each other and, hence, f(x;) and f(x2) are close to each other. This suggests the use of the Cauchy 
E 

criterion for limit to solve the problem. Given any € > 0, choose 6 = D(k+ 1)" If x1,x2 € D\ {x} 

with |x; —x| < 6 and |x2 —x| < 6, then 


E 


| f(x1) — f(x2)| < klx1 —x2| < k(|x1 —X| + |x2 —X|) < k(5 +0) oh 1) < e, 


Therefore, lim,_,< f(x) exists. 


SECTION 3.3 

Exercise 3.3.8. (a) Observe that f(a) = g(a) = h(a) and, hence, 

— f(a)|= lg(x)—g(a)|, if xe QN[0, 1]; 
|h(x)—h(a)|, if xe Q°N[0, 1]. 


It follows that 


If (x) — F(@)| S |s(*) — g(@)| + |A(x) — A(a@)| for all x € [0, 1]. 


Therefore, lim,_,< f(x) = f(a) and, so, f is continuous at a. 
(b) Apply part (a). 


Exercise 3.3.9. At any irrational number a € (0, 1], we have f(a) = 0. If x is near a and x is irrational, 
it is obvious that f(x) = 0 is near f(a). In the case when x is near a and x is rational, f(x) = 1/q 
where p,q € N. We will see in part (a) that for any € > 0, there is only a finite number of x € (0, 1] 
such that f(x) > €. So f(x) is close to f(a) for all x € (0, 1] except for a finite number of x € Q. 
Since a is irrational, we can choose a sufficiently small neighborhood of a to void such x. 


(a) For any € > 0, 


Ae= {xe O,:f6) 2€)}={x=2 €@: f0)=22eb={x-Zeaasch. 
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Clearly, the number of g € N such that g < 7 is finite. Since 0 < - <1, we have p < q. Therefore, 
Ag is finite. 


(b) Fix any irrational number a € (0, 1]. Then f(a) = 0. Given any € > 0, by part (a), the set Ag is 
finite, so we can write 


Ap={xe (01) Sila) Sb A toess tats 


for some n € N, where x; € Q for all i= 1,...,n. Since a is irrational, we can choose 6 > 0 such that 
x; ¢ (a—6,a+6) for all i=1,...,n (more precisely, we can choose 6 = min{|a—x;|:i=1,...,n}). 
Then 


| f(x) — f(a)| = f(x) < € whenever |x—a| < 6. 
Therefore, f is continuous at a. 
Now fix any rational number b = A € (0,1). Then f(b) = 1. Choose a sequence of irrational 
numbers {s,,} that converges to b. Since f(s,) =0 for all n € N, the sequence {f(s,)} does not 
converge to f(b). Therefore, f is not continuous at b. 


In this problem, we consider the domain of f to be the interval (0, 1], but the conclusion remain valid 
for other intervals. In particular, we can show that the function defined on R by 
1, DP 
—, if x=-—,p,q€N,where p and qg have no common factors; 
q q 
fO=41, if x=0: 


1 
0, if xis irrational, 


is continuous at every irrational point, and discontinuous at every rational point. 


Exercise 3.3.10. Consider 


_ | aia) (a—a@), fxeQ; 
P(x) = ‘¢ if xe O°. 


SECTION 3.4 
Exercise 3.4.6. Let @ = min{ f(x) : x € [a,b]} and B = max { f(x) : x € [a,b] }. Then 


Fle) + flea) +--+ Flin) < WB g 


n n 


Similarly, 


F (x1) + fa) Fe Fon) 


a< ; 
n 


Then the conclusion follows from the Intermediate Value Theorem. 


Exercise 3.4.7. (a) Observe that 


|f(1/n)| < 1/n for allneN. 
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(b) Apply the Extreme Value Theorem for the function g(x) = 4 


x 


on the interval [a,b]. 


Exercise 3.4.8. First consider the case where f is monotone decreasing on [0, 1]. By Exercise 3.4.5, 
f has a fixed point in [0,1], which means that there exists xo € [0, 1] such that 


t (xo) = Xo: 
Since f is monotone decreasing, f has a unique fixed point. Indeed, suppose that there exists 
x; € [0,1] such that f(x) ) =x. Ifx1 < xo, then x) = f (x1) > f(x0) = x0, which yields a contradiction. 
It is similar for the case where x; > xo. Therefore, xo is the unique point in [0, 1] such that f(xo) = xo. 
Since f(g(x)) = g(f(x)) for all x € [0, 1], we have 
f(8(%0)) = 8(F(x0)) = 80). 


Thus, g(xo) is also a fixed point of f and, hence, g(x) = xo = f (xo). The proof is complete in this 
case. 


Consider the case where f is monotone increasing. In this case, f could have several fixed points on 
[0, 1], so the previous argument does not work. However, by Exercise 3.4.5, there exists c € [0,1] 
such that g(c) = c. Define the sequence {x,} as follows: 


x1 =C, 
Xn+1 = f(x) for all n > 1. 


Since f is monotone increasing, {x,} is a monotone sequence. In fact, if x; < x2, then {x,} is 
monotone increasing; if x; > x2, then {x,} is monotone decreasing. Since f is bounded, by the 
monotone convergence theorem (Theorem 2.3.1), there exists xo € [0,1] such that 


lim x7 = Xo. 
n—y00 
Since f is continuous and x,+1 = f(x,) for all n € N, taking limits we have f(xo) = xo. 
We can prove by induction that g(x,) =x, for alln € N. Then 
g(xo) = lim g(x) = limx, = x0. 
n—co 


Therefore, f(x0) = g(x0) = Xo. 


SECTION 3.5 


Exercise 3.5.2. (a) Let f: D — R. From Theorem 3.5.3 we see that if there exist two sequences {x, } 
and {y,} in D such that |x, —yn| + 0 as n + ©, but {| f(x) — f(¥n)|} does not converge to 0, then 
f is not uniformly continuous on D. Roughly speaking, in order for f to be uniformly continuous on 
D, if x and y are close to each other, then f(x) and f(y) must be close to each other. The behavior 
of the graph of the squaring function suggests the argument below to show that f(x) = x? is not 
uniformly continuous on R. 


1 
Define two sequences {x,} and {y,} as follows: x, =n and y, =n+-— forn€N. Then 
n 


1 
a= Pal = 7 0 as n —> «0. However, 


1\? 1 
lf (%n) —fOn)| = (+2) —w=2+5 >2forallnEeN. 
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Therefore, {| f(x) — f(¥n)|} does not converge to 0 and, hence, f is not uniformly continuous on R. 


. : 1 : 
In this solution, we can use x, = ,/n+ — and y, = \/n for n € N instead. 
n 


(b) Use x, = nd y, = neN. 


1 1 
m/2+2nn : 2nn 


(c) Use x, = 1/n and y, = 1/(2n). 


3 


It is natural to ask whether the function f(x) =.x° is uniformly continuous on R. Following the 


/ | 
solution for part (a), we can use x, = ¢/n+ — and y, = \/n for n € N to prove that f is not uniformly 
n 


continuous on R. By a similar method, we can show that the function f(x) =x", n € N, n > 2, is not 
uniformly continuous on R. A more challenging question is to determine whether a polynomial of 
degree greater than or equal to two is uniformly continuous on R. 


Exercise 3.5.7. Hint: For part (a) use Theorem 3.5.5. For part (b) prove that the function can be 
extended to a continuous function on [a,b] and then use Theorem 3.5.5. 


Exercise 3.5.8. (a) Applying the definition of limit, we find b > a such that 
c—1< f(x) <c+1 whenever x > b. 


Since f is continuous on [a,b], it is bounded on this interval. Therefore, f is bounded on [a,°-). 
(b) Fix any € > 0, by the definition of limit, we find b > a such that 


E 
| f(x) —e| < . whenever x > b. 


Since f is continuous on [a,b + 1], it is uniformly continuous on this interval. Thus, there exists 
0 <6 < 1 such that 


|f(u) — f(v)| < whenever |u—v| < 6,u,v € [a,c +1]. 


Then we can show that | f(u) — f(v)| < € whenever |u—v| < 6, u,v € [a,°). 
(c) Since lim,_,.. f(x) =c > f(a), there exists b > a such that 


f(x) > f(a) whenever x > b. 


Thus, 
inf{ f(x) : x € [a,cc)} = inf{ f(x) : x € [a,b] }. 


The conclusion follows from the Extreme Value Theorem for the function f on [a,)]. 


SECTION 3.6 


Exercise 3.7.4. Since lim,_,.. f(x) = lim,,_. f(x) =, there exists a > 0 such that 


f(x) => f(0) whenever |x| > a. 
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Since f is lower semicontinuous, by Theorem 3.7.3, it has an absolute minimum on [—a,a] at some 
point * € [—a,a]. Obviously, 
f(x) => F(X) for all x € [—a,a]. 


In particular, f(0) > f(x). If |x| > a, then 
f(x) 2 F(0) > fF). 


Therefore, f has an absolute minimum at x. 

Observe that in this solution, we can use any number y in the range of f instead of f(0). Since 
any continuous function is also lower semicontinuous, the result from this problem is applicable for 
continuous functions. For example, we can use this theorem to prove that any polynomial with even 
degree has an absolute minimum on R. Since R is a not a compact set, we cannot use the extreme 
value theorem directly. 


SECTION 4.1 
Exercise 4.1.10. Use the identity 


noo 


i fats) _ im ex n : —In 
in (SE) — im p(nlin(f(a-+—)) —In(f(a))). 


Exercise 4.1.11. (a) Using the differentiability of sinx and Theorem 4.1.3, we conclude the function 
is differentiable at any a £ 0. So, we only need to show the differentiability of the function at a = 0. 
By the definition of the derivative, consider the limit 


7 2 
im f(x) — f(a) tim“ sin(1/x) + cx 
xa x—a x0 x 


= lim [xsin(1 /x) +c]. 

For any x 4 0, we have 
lxsin(1/x)| =[a||sin(1/x)| < |x, 

which implies 
—|x| < xsin(1/x) < |x]. 

Since lim,_,9(—|x|) = lim,_,0 |x| = 0, applying the squeeze theorem yields 
lim xsin(1/x) =0. 

It now follows that 


(0) = timfQ—L 


=li in(1 =Cc. 
lim ~~ — Tim [x sin( /x)+c]l=c 


Using Theorem 4.1.3 and the fact that cos. is the derivative of sin, the derivative of f can be written 
explicitly as 


f= 2vsin + —cos(1/x) +e, if x £0; 


C, if x=0. 
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From the solution, it is important to see that the conclusion remains valid if we replace the 
function f by 


1 

x"sin-, ifx 40; 
x 

0, if x=0, 


where n > 2,n € N. Note that the function h(x) = cx does not play any role in the differentiability 
of f. 
We can generalize this problem as follows. Let @ be a bounded function on R, i.e., there is 
M > 0 such that 
|\p(x)| <M for allx ER. 


Define the function 


jx" @(l/x), ifx #0; 
= {5 if x=0, 


where n > 2,n € N. Then f is differentiable at a = 0. 
Similar problems: 


1. Show that the functions below are differentiable on R: 


x3/2 cos(1 x), ifx>0; 
re ={ oe 
0, if x<0 


and 


f(x) = Pel? ifx £0; 
0, if x=0. 


2. Suppose that @ is bounded and differentiable on IR. Define the function 


roy fees tte 


Show that if m > 2, the function is differentiable on R and find its derivative. Show that if nm = 1 and 
lim. P(x) does not exists, then f is not differentiable at 0. 


(b) Hint: Observe that 


1 1 1 I 
f(s2) +c <Oand f (oste +c>0 


SECTION 4.2 


Exercise 4.2.1. Define the function 
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Then h/ has an absolute maximum at xp. Thus, 
h' (xo) = f' (x0) — g' (x0) = 0, 
which implies f’(xo) = g’ (xo). 


Exercise 4.2.3. The inequality holds obviously if a = b. In the case where a ¥ b, the equality can be 
rewritten as 


sin(b) — sin(a) 


<1. 
b-a ~ 


in(b) — Sj 

The quotient pie ee 
—a 

to show that the absolute value of the slope is always bounded by 1, which can also be seen from 

the figure. The quotient also reminds us of applying the Mean Value Theorem for the function 


f(x) = sin(x). 


is the slope of the line connecting (a, f(a)) and (b, f(b)). We need 


ASS See SS ae f(x) = sin(a) 


Figure 5.1: The function f(x) = sin(x). 


Consider the case where a < b and define the function f: [a,b] + R by f(x) = sin(x). Clearly, 
the function satisfies all assumptions of the Mean Value Theorem on this interval with f’(x) = cos(x) 
for all x € (a,b). 

By the Mean Value Theorem, there exists c € (a,b) such that 


PO) Sa) = f'(c) =cos(c), 


which implies 


eee 
b-—a 


=(|cos(e)| = 1. 


It follows that | f(a) — f(b)| < |a—b]|. The solution is similar for the case where a > b. 
It is essential to realize that the most important property required in solving this problem is the 
boundedness of the derivative of the function. Thus, it is possible to solve the following problems 
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with a similar strategy. 
1. Prove that | cos(a) — cos(b)| < |a—b| for alla,b ER. 


2. Prove that | In(1 + e?“) —In(1 + e””)| < 2|a—b| for all a,b ER. 
Exercise 4.2.4. Let us define f: |[—2,2] > R by 
n 
f(x) =x4+ >, (az sinkx + by cos kx). 


We want to find c € (—2,7) such that f(c) =0. 
Now, consider the function 


a cos(kx in(kx 
wey (nS nl), 


k=1 


Observe that g(—7) = g(z) and g’ = f. The conclusion follows from Rolle’s Theorem. 


Exercise 4.2.5. Use the identity 


(a) _ f(b) 
1 f(a) f(d) | _ f(a)g(b) — f(0)s(@) _ xa) ~ x16) 
g(b) —g(a)| g(a) g(b) g(b) —8(@) eC 
Then apply the Cauchy mean value theorem for two functions @(x) = a and w(x) = aa on the 
interval [a,b]. 
Exercise 4.2.6. 1. Apply Rolle’s theorem to the function 
2 n 


on the interval {0, 1]. 
2. Apply Rolle’s theorem to the function 


" sin(2k+ 1 
Ka Maras 


k=0 
on the interval [0, 7/2]. 


Exercise 4.2.8. (a) Given € > 0, first find xp large enough so that a— €/2 < f’(x) <a+e/2 for 
x > xo. Then use the identity 


S(a—F(x S (x 
Ff) _ f@-FG0) +0) _ SSP + 
x x—X9 +xo Lo : 


and the mean value theorem to show that, for x large, 


f(x) 


a-—E<——<a-+t€. 
x 


(b) Use the method in part (a). 
(c) Consider f(x) = sin(x). 
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SECTION 4.3 


Exercise 4.3.2. (a) We can prove that f is uniformly continuous on R by definition. Given any € > 0, 


choose 6 = ( ) and get 


= 
£+1 
E 
_ < _ a a _ Saar 
|f(u) — f(v)| < Alu—v|* < £6 Tq 


whenever |u — v| < 6. Note that we use @+ | here instead of @ to avoid the case where ¢ = 0. 


(b) We will prove that f is a constant function by showing that it is differentiable on R and f’(a) =0 
for all a € R. Fix any a € R. Then, for x 4a, 


Ee =Fla)| Meal yaya, 
x—a |x—al 
Since a@ > 1, by the squeeze theorem, 
i OT), 
Xa x-a 


This implies that f is differentiable at a and f’(a) = 0. 
(c) We can verify that the function f(x) = |x| satisfies the requirement. 


From this problem, we see that it is only interesting to consider the class of functions that satisfy 
(4.8) when @ < 1. It is an exercise to show that the function f(x) = |x|!/? satisfies this condition 
with = | and a = 1/2. 


Exercise 4.3.3. Define the function 


Then h’(x) = g'(x) — f’(x) > 0 for all x € [xo,00). Thus, 4 is monotone increasing on this interval. It 
follows that 
h(x) > h(xo) = g(xo) — f (xo) = 0 for all x > xo. 


Therefore, g(x) > f(x) for all x > xo. 
Exercise 4.3.5. Apply the mean value theorem twice. 


Exercise 4.3.6. Use proof by contradiction. 


SECTION 4.4 


Exercise 4.4.5. Suppose that 
P(x) =ag+ayx+--->+ayx". 


Then apply L’ Hospital’s rule repeatedly. 
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Exercise 4.4.6. We first consider the case where n = | to get ideas for solving this problem in the 
general case. From the standard derivative theorems we get that the function is differentiable at any 
x #0 with 


Consider the limit 


x0 De x70 X 
Letting t = 1/x and applying L’ Hospital rule yields 


1 


. er ae: . 1 
lim = lim —, = lim —_, = 0. 
x0t Xx too el” t+ Dt el 
Similarly, 
1 
ee 
lim =0. 
x70- X 


It follows that f is differentiable on R with 


2, 20) - 
ijn ge Fe Bee’: 
0, if x=0. 


In a similar way, we can show that f is twice differentiable on R with 


2\ _ 
at alew, tae 
Xx 


0, if x=0. 
Based on these calculations, we predict that f is n times differentiable for every n € N with 
2% 4 
f(x) _ P oo oie if x 4 0; 
0, if x=0, 


where P is a polynomial. Now we proceed to prove this conclusion by induction. The conclusion is 
true for n = | as shown above. Given that the conclusion is true for some n € N, for x 4 0 we have 


1 2 1\ _4 1\ 4 
FN G) =—x°P’ (<) tae (=) erv=Q (=) e*, 


where Q is also a polynomial. It is an easy exercise to write the explicit formula of Q based on P. 
Moreover, successive applications of |’ H6pital’s rule give 


(n) _ #£(n) 
fig ET 0) = him “p (=) e° = tim 2? =o 
Xx 


x30t x—O0 x0t X 
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Therefore, f (n+1) (0) = 0. We have proved that for every n € N, f is n times differentiable and, so, 
f © C"(R). Here we do not need to prove the continuity of f (") because the differentiability of f(”) 
implies its continuity. 

In a similar way, we can also show that the function 


1 
ex, ifx>0O; 
= {6 220 


is n times differentiable for every n € N. 


SECTION 4.5 
Exercise 4.5.1. Let f(x) = e*. By Taylor’s theorem, for any x > 0, there exists c € (0,x) such that 


LOO a FO ws 
fe =P kl x AT (m+ 1)! © 
m xk ef ae m xk 
=P —4+—_c™1 5 y _. 
aac esis da 


Exercise 4.5.5. (a) Observe that a simpler version of this problem can be stated as follows: If f is 
differentiable on (a,b) and * € (a,b), then 
fE+h)-f@ _ f'@) 


li — 
hoo h 1! 


This conclusion follows directly from the definition of derivative. 
Similarly, if f is twice differentiable on (a,b) and x € (a,b), then 
im et -f@-f On _ £'@ 


h-0 h? 2! 


We can prove this by applying the L’ Hospital rule to get 


FE+H)-FO-FOH_ SE+H-F@ _/£'@ 
n—0 h2 =) 2h Ot 


It is now clear that we can solve part (a) by using the L’ Hospital rule as follows: 


‘i fE+h)-f(®H-f' 4 f(a ein f' (+h) —f' (® —f"@)4 ad 
a0 h3 =) 3h2 3h 


Note that the last equality follows from the previous proof applied to the function f’. 


(b) With the analysis from part (a), we see that if f is n times differentiable on (a,b) and x € (a,b), 
then 
(k) (=) pk 
= | n—-1 y (x)h 
F(E+M) — Yi9 FG f (8) 


lim : — 
h-0 prt n! 


This conclusion can be proved by induction. This general result can be applied to obtain the Taylor 
expansion with Peano’s remainder in Exercise 4.5.6. 
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SECTION 4.6 


Exercise 4.6.3. We apply the definition to solve this problem. Given any u,v € J and A € (0,1), we 
have 


f(Aut+(1—A)v) SAf(u) +1 -A)F(Y) 
by the convexity of f. 


Since f(u), f(v) € J and J is an interval, Af(u) + (1—A)f(v) € J. By the nondecreasing 
property and the convexity of @, 


p(fAut(l—A)v)) < oAFW) + -A)FY)) SAG FW) +A) OF). 


Therefore, @ 0 f is convex on J. 

The result from this problem allows us to generate convex functions. For example, consider 
f(x) = |x| and @(x) =x’, p > 1. We have seen that f is convex on R. The function ¢ is convex 
and increasing on [0,°¢) which contains the range of the function f. Therefore, the composition 
g(x) = |x|”, p > 1, is convex on R. Similarly, h(x) = e* is also a convex function on R. 

Observe that in this problem, we require the nondecreasing property of @. A natural question is 
whether the composition of two convex functions is convex. The answer is negative. Observe that 
f (x) =x? and (x) = |x—1| are convex, but (@ 0 f)(x) = |x? — 1| is nonconvex. 


Exercise 4.6.4. Use Theorem 4.6.6 or Corollary 4.6.7. 


Exercise 4.6.5. (a) Use the obvious inequality 
(Va—vb)° > 0. 


Alternatively, consider the function f(x) = —In(x), x € (0,c°). We can show that f is convex on 
(0,0). For a,b € (0,00), one has 


(=) < Fla) + FB) 


2 2 
This implies 
iat : . < ney In(b) 2 eae 
Therefore, 
te > ab. 


This inequality holds obviously when a = 0 or b= 0. 
(b) Use Theorem 4.6.3 for the function f(x) = —In(x) on (0,°°). 


SECTION 4.7 
Exercise 4.7.1. (a) By Theorem 4.7.5, 
{-a}, if x<0; 
Of (x) = 4 [-a,a], if x=0; 
{a}, i > 0, 
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(b) By Theorem 4.7.5, 


{-2}, if x<-l; 


[-2,0], if x=—1; 
Of (x) = 4 {0}, if we (1,1); 
(0,2), if x=1; 


{2}, if x>1. 


Exercise 4.7.3. To better understand the problem, we consider some special cases. If n = 1, then 
f(x) =|x- 1]. Obviously, f has an absolute minimum at x = 1. If n = 2, then f(x) = |x—1|+|x—2]. 
The graphing of the function suggests that f has an absolute minimum at any x € [1,2]. In the case 
where n = 3, we can see that f has an absolute minimum at x = 2. We then conjecture that if n is 
odd with n = 2m — 1, then f has an absolute minimum at x = m. If n is even with n = 2m, then f 
has an absolute minimum at any point x € [m,m-+ 1]. 

Let us prove the first conclusion. In this case, 


2m—1 2m—1 


f(x) = d |x—i] = d Sil), 


where fj(x) = |x—i|. Consider x = m. Then 
O fn(x) = [—1,1], Ofi(%) = {1} ifi< m, Ofi(x) = {-1} ifi>m. 


The subdifferential sum rule yields 0 f(x) = [—1,1] which contains 0. Thus, f has an absolute 
minimum at x. If x > m, we can see that 0 f(x) C (0,°°), which does not contain 0. Similarly, if 
xX <m, then 0 f(x) C (—e°,0). Therefore, f has an absolute minimum at the only point « = m. 

The case where n is even can be treated similarly. 


Exercise 4.7.5. Fix a,b € R with a < b. By Theorem 4.7.9, there exists c € (a,b) such that 


f(b)-f@) 


Bie € Of(c) C (0,2). 


This implies f(b) — f(a) > 0 and, hence, f(b) > f(a). Therefore, f is monotone increasing on R, 
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